00000100:00100000:2.0:1776190903.136752:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613766656
00000100:00100000:2.0:1776190903.136784:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4072
00000100:00100000:2.0:1776190903.136790:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d36adb63 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613766720:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776190903.136870:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d36adb63 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613766720:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 80us (4734us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190903.136877:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4072
00000100:00100000:2.0:1776190904.570516:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1776190904.570533:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000023fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630822272:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776190904.570609:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190904.570947:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000023fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630822272:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776190905.597075:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630822336
00000100:00100000:2.0:1776190905.597173:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2782
00000100:00100000:2.0:1776190905.597179:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae6c8b4c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630822336:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776190905.597212:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776190905.597359:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae6c8b4c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630822336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 179us (899us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190905.597366:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2782
00000100:00100000:2.0:1776190906.618538:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776190906.618560:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000150035b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630822400:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776190906.618627:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190906.618676:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630822400
00000100:00100000:2.0:1776190906.618713:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405
00000100:00100000:2.0:1776190906.618719:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c95e149a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630822400:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776190906.618747:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776190906.618784:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c95e149a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630822400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (157us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190906.618795:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405
00000100:00100000:2.0:1776190906.618846:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000150035b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630822400:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776190908.258109:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613766912
00000100:00100000:2.0:1776190908.258158:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1557
00000100:00100000:2.0:1776190908.258165:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ac96f048 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613766912:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776190908.258232:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ac96f048 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613766912:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 67us (418us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190908.258240:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1557
00000100:00100000:2.0:1776190908.261569:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2022
00000100:00100000:2.0:1776190908.261575:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000057916d34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613767168:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:2.0:1776190908.261679:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776190908.261724:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000057916d34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613767168:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 149us (9765us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776190908.261732:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2022
00000100:00080000:2.0:1776190911.741617:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776190911.741624:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776190911.741628:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776190911.741635:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3444
00000100:00080000:2.0:1776190911.741638:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776190911.741643:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776190911.741664:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000dd5f2099 x1862467630823680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776190911.741680:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776190911.741684:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776190911.741686:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776190911.741693:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3444
00000100:00080000:2.0:1776190911.741697:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776190911.741701:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776190911.741713:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000ec6658fe x1862467630823744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776190911.741754:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1776190911.741765:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000449a0225 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630823872:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190911.741804:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190911.742060:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000449a0225 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630823872:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190911.745744:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2024
00000100:00100000:2.0:1776190911.745756:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000078deb88d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630823744:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776190911.745872:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776190911.745947:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000078deb88d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630823744:12345-0@lo:8:kworker/u8:4.0 Request processed in 192us (4100us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776190911.745955:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2024
00000100:00100000:2.0:1776190911.746001:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630823360
00000100:00100000:2.0:1776190911.746052:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1558
00000100:00100000:2.0:1776190911.746057:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b37044fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630823360:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190911.746101:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b37044fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630823360:12345-0@lo:400:kworker/u8:4.0 Request processed in 43us (3860us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190911.746107:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1558
00000100:00100000:2.0:1776190911.746154:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004b61d099 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630823360:0@lo:400:kworker/u8:4.0
00000100:00080000:2.0:1776190911.746303:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776190911.746308:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776190911.746311:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5f2099 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630823680:0@lo:8:kworker/u8:4.0
00000100:00080000:2.0:1776190911.746321:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776190911.746323:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776190911.746325:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec6658fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630823744:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776190911.746363:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be4c283a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630823552:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190911.746374:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006b668658 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630823488:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190913.372404:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776190913.372436:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776190913.372472:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776190913.372538:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776190914.810560:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630823936
00000100:00100000:2.0:1776190914.810666:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2789
00000100:00100000:2.0:1776190914.810673:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b668658 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630823936:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776190914.810705:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776190914.810753:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b668658 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630823936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (288us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190914.810760:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2789
00000100:00080000:2.0:1776190916.862737:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776190916.862743:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776190916.862746:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776190916.862753:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3449
00000100:00080000:2.0:1776190916.862757:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776190916.862764:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776190916.862786:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000589db251 x1862467630824512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776190916.862804:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776190916.862807:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776190916.862892:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776190916.862897:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3449
00000100:00080000:2.0:1776190916.863063:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776190916.863069:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776190916.871121:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000a48cc882 x1862467630824576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776190916.872096:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630824576
00000100:00100000:2.0:1776190916.872144:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2027
00000100:00100000:2.0:1776190916.872150:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000589db251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630824576:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776190916.872247:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776190916.872310:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000589db251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630824576:12345-0@lo:8:kworker/u8:4.0 Request processed in 159us (911us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776190916.872317:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2027
00000100:00080000:2.0:1776190916.872353:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776190916.872356:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776190916.872360:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a48cc882 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630824576:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776190916.873377:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630824640
00000100:00100000:2.0:1776190916.873414:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4088
00000100:00100000:2.0:1776190916.873419:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004385f089 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630824640:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190916.873635:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004385f089 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630824640:12345-0@lo:400:kworker/u8:4.0 Request processed in 214us (1551us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190916.873649:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4088
00000100:00100000:2.0:1776190918.490389:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776190918.524360:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613767616
00000100:00100000:2.0:1776190918.524586:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613767680
00000100:00100000:2.0:1776190919.930464:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630824768
00000100:00100000:2.0:1776190919.930526:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2793
00000100:00100000:2.0:1776190919.930534:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000150035b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630824768:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776190919.930575:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776190919.930629:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000150035b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630824768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (252us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190919.930644:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2793
00000100:00100000:2.0:1776190921.978232:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e15780a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630825024:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190921.978292:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190921.978326:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000fcbb87d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630825280:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190921.978357:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190921.978374:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:2.0:1776190921.978379:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008a7a5282 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630825088:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190921.978400:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190921.978414:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009374bd90 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630825344:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190921.978432:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190921.978456:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c944797f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630825408:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776190921.978476:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190921.978504:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630825088
00000100:00100000:2.0:1776190921.978537:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2795
00000100:00100000:2.0:1776190921.978542:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc2a3d25 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630825088:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190921.978584:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc2a3d25 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630825088:12345-0@lo:400:kworker/u8:2.0 Request processed in 41us (184us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190921.978621:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2795
00000100:00100000:2.0:1776190921.978718:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008a7a5282 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630825088:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190921.978752:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630825024
00000100:00100000:2.0:1776190921.978776:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4092
00000100:00100000:2.0:1776190921.978779:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c2f2cb97 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630825024:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190921.978811:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c2f2cb97 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630825024:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (523us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190921.978817:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4092
00000100:00100000:2.0:1776190921.978839:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630824896
00000100:00100000:2.0:1776190921.978872:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411
00000100:00100000:2.0:1776190921.978875:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af172616 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630824896:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776190921.978895:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776190921.978922:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af172616 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630824896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (632us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190921.978927:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411
00000100:00100000:2.0:1776190921.978951:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e15780a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630825024:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190921.978975:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630825280
00000100:00100000:2.0:1776190921.978995:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630825344
00000100:00100000:2.0:1776190921.979007:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630825408
00000100:00100000:2.0:1776190921.979020:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1813
00000100:00100000:2.0:1776190921.979023:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f739a423 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630825280:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190921.979074:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f739a423 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630825280:12345-0@lo:400:kworker/u8:2.0 Request processed in 49us (716us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190921.979082:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1813
00000100:00100000:2.0:1776190921.979093:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1814
00000100:00100000:2.0:1776190921.979096:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001672005a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630825344:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190921.979119:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001672005a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630825344:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (687us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190921.979123:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1814
00000100:00100000:2.0:1776190921.979132:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2029
00000100:00100000:2.0:1776190921.979136:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b538d61e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630825408:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776190921.979238:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776190921.979268:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b538d61e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630825408:12345-0@lo:8:kworker/u8:2.0 Request processed in 131us (792us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776190921.979274:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2029
00000100:00080000:2.0:1776190921.979294:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776190921.979298:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776190921.979301:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c944797f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630825408:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776190921.979322:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009374bd90 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630825344:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190921.980216:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000fcbb87d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630825280:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190921.980285:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030c9704c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630824960:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190921.980327:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190921.980350:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000663e13fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630825216:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190921.980729:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190921.980765:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030c9704c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630824960:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190921.980778:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:2.0:1776190921.980785:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008169e6c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630825152:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190921.980807:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190921.980822:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000090a9e988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630825472:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776190921.980851:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190921.980878:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630825152
00000100:00100000:2.0:1776190921.980903:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4093
00000100:00100000:2.0:1776190921.980906:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a7a5282 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630825152:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190921.980942:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a7a5282 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630825152:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (135us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190921.980948:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4093
00000100:00100000:2.0:1776190921.980981:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008169e6c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630825152:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190921.983580:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000604d7be5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630825536:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776190921.983613:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190923.618709:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613768128
00000100:00100000:2.0:1776190923.618758:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613768064
00000100:00100000:2.0:1776190923.618806:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1815
00000100:00100000:2.0:1776190923.618813:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008291e08d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613768064:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776190923.618894:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008291e08d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613768064:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 81us (7295us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190923.618902:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1815
00000100:00100000:2.0:1776190923.618919:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2031
00000100:00100000:2.0:1776190923.618923:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000994ca5e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613768128:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:2.0:1776190923.619019:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776190923.619063:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000994ca5e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613768128:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 139us (7492us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776190923.619069:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2031
00000100:00100000:2.0:1776190925.050507:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776190925.050526:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000090a9e988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630825728:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776190925.050592:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190927.101691:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1776190927.101703:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630826560:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776190927.101754:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190927.101790:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630826560
00000100:00100000:2.0:1776190927.101831:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413
00000100:00100000:2.0:1776190927.101835:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000002f18e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630826560:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776190927.101862:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776190927.101909:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000002f18e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630826560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (155us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190927.101915:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413
00000100:00100000:2.0:1776190927.101947:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630826560:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776190927.103468:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a0236b56 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630826624:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776190927.103520:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190927.106134:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a0236b56 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630826624:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776190928.732391:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613768448
00000100:00100000:2.0:1776190928.732424:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613768384
00000100:00100000:2.0:1776190928.732497:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1818
00000100:00100000:2.0:1776190928.732501:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dbd40b9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613768384:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776190928.732544:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dbd40b9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613768384:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 41us (1235us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190928.732551:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1818
00000100:00100000:2.0:1776190928.732566:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2034
00000100:00100000:2.0:1776190928.732569:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c58da4dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613768448:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:2.0:1776190928.732660:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776190928.732686:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c58da4dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613768448:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 115us (1518us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776190928.732692:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2034
00000100:00100000:2.0:1776190930.173271:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630826688
00000100:00100000:2.0:1776190930.173314:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2801
00000100:00100000:2.0:1776190930.173319:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f09a8ca pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630826688:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776190930.173356:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776190930.173432:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f09a8ca pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630826688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (295us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190930.173439:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2801
00000100:00100000:2.0:1776190932.218464:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1776190932.218480:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d71ef7e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630826816:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776190932.218546:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190932.218588:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630826816
00000100:00100000:2.0:1776190932.218636:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415
00000100:00100000:2.0:1776190932.218641:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f3626cf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630826816:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776190932.218671:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776190932.218717:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f3626cf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630826816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (171us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190932.218723:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415
00000100:00100000:2.0:1776190932.220677:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000075933c7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630827008:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190932.220707:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190932.220727:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1776190932.220732:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000663e13fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630827200:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190932.220769:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190932.220798:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630827008
00000100:00100000:2.0:1776190932.220832:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4104
00000100:00100000:2.0:1776190932.220837:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d71ef7e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630827008:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190932.220879:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d71ef7e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630827008:12345-0@lo:400:kworker/u8:4.0 Request processed in 41us (171us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190932.220885:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4104
00000100:00100000:2.0:1776190932.220914:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000075933c7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630827008:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190932.220945:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f135e4dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630827072:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190932.220978:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190932.220995:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776190932.220999:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057916d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630827136:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190932.221023:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190932.221060:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630827136
00000100:00100000:2.0:1776190932.221083:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4105
00000100:00100000:2.0:1776190932.221086:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a79a7791 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630827136:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190932.221129:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a79a7791 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630827136:12345-0@lo:400:kworker/u8:4.0 Request processed in 41us (105us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190932.221135:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4105
00000100:00100000:2.0:1776190932.221160:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057916d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630827136:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190932.221203:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630827200
00000100:00100000:2.0:1776190932.221227:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630827072
00000100:00100000:2.0:1776190932.221238:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2803
00000100:00100000:2.0:1776190932.221242:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eac92920 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630827200:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190932.221275:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eac92920 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630827200:12345-0@lo:400:kworker/u8:4.0 Request processed in 32us (507us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190932.221281:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2803
00000100:00100000:2.0:1776190932.221292:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2804
00000100:00100000:2.0:1776190932.221296:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef14d805 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630827072:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190932.221326:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef14d805 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630827072:12345-0@lo:400:kworker/u8:4.0 Request processed in 29us (347us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190932.221331:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2804
00000100:00100000:2.0:1776190932.221353:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000663e13fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630827200:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190932.221386:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f135e4dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630827072:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190932.225400:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002271bdf7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630827392:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190932.225639:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190932.227390:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002271bdf7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630827392:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190933.854535:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613768576
00000100:00100000:2.0:1776190933.854578:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4108
00000100:00100000:2.0:1776190933.854585:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009374bd90 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613768576:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776190933.855936:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009374bd90 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613768576:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 1334us (2022us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190933.855950:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4108
00000100:00100000:2.0:1776190935.291001:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630827520
00000100:00100000:2.0:1776190935.291093:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2805
00000100:00100000:2.0:1776190935.291099:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f7c58b5d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630827520:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776190935.291131:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776190935.291179:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f7c58b5d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630827520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (438us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190935.291185:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2805
00000100:00100000:2.0:1776190936.314456:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1776190936.314473:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ce45b6e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630827584:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776190936.314543:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190936.314587:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630827584
00000100:00100000:2.0:1776190936.314636:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2806
00000100:00100000:2.0:1776190936.314642:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000006c85329 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630827584:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776190936.314673:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776190936.314723:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000006c85329 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630827584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (181us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190936.317929:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2806
00000100:00100000:2.0:1776190937.338791:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630828160
00000100:00100000:2.0:1776190937.338826:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630828032
00000100:00100000:2.0:1776190937.339375:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1821
00000100:00100000:2.0:1776190937.339380:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f370bd8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630827968:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190937.350730:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630827776
00000100:00100000:2.0:1776190937.350782:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2807
00000100:00100000:2.0:1776190937.350791:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001abea6d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630827776:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190937.352653:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001abea6d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630827776:12345-0@lo:400:kworker/u8:2.0 Request processed in 1861us (14027us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190937.352668:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2807
00000100:00100000:2.0:1776190937.352769:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f370bd8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630827968:12345-0@lo:400:kworker/u8:2.0 Request processed in 13387us (14018us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190937.352777:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1821
00000100:00100000:2.0:1776190937.352841:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630828224
00000100:00100000:2.0:1776190937.352874:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630828288
00000100:00100000:2.0:1776190937.352894:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4110
00000100:00100000:2.0:1776190937.352898:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003c00620b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630827712:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190937.353009:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003c00620b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630827712:12345-0@lo:400:kworker/u8:2.0 Request processed in 110us (14297us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190937.353015:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4110
00000100:00100000:2.0:1776190937.353028:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4111
00000100:00100000:2.0:1776190937.353031:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef3b35f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630828224:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190937.353514:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef3b35f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630828224:12345-0@lo:400:kworker/u8:2.0 Request processed in 481us (2698us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190937.353521:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4111
00000100:00100000:2.0:1776190937.353536:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4112
00000100:00100000:2.0:1776190937.353622:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000083dffaa0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630828288:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190937.353659:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000083dffaa0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630828288:12345-0@lo:400:kworker/u8:2.0 Request processed in 118us (2672us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190937.353665:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4112
00000100:00100000:2.0:1776190937.353782:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002271bdf7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630827712:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190937.353799:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b065f1b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630827968:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190937.353812:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000431a05c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630827776:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190937.353826:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fd716f95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630828032:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190937.353872:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ce45b6e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630828416:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776190937.355518:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190937.356227:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000039985528 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630828224:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190937.356597:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190938.971669:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613768896
00000100:00100000:2.0:1776190938.971704:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4114
00000100:00100000:2.0:1776190938.971709:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f66c2091 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613768896:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776190938.971749:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f66c2091 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613768896:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 38us (653us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190938.971756:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4114
00000100:00100000:2.0:1776190938.975129:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613769024
00000100:00100000:2.0:1776190938.975175:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1822
00000100:00100000:2.0:1776190938.975180:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007003430f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613769024:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776190938.975243:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007003430f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613769024:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 61us (1514us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190938.975250:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1822
00000100:00100000:2.0:1776190938.978091:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613769088
00000100:00100000:2.0:1776190938.978139:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2040
00000100:00100000:2.0:1776190938.978145:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f2ed044 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613769088:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:2.0:1776190938.978242:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776190938.978301:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f2ed044 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613769088:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 156us (331us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776190938.978309:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2040
00000100:00100000:2.0:1776190940.410876:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1776190940.412881:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f93569a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630828480:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776190940.412963:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190941.434687:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1776190941.434701:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f5f736f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630828544:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776190941.434776:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190942.460571:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630828800
00000100:00100000:2.0:1776190942.460610:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4116
00000100:00100000:2.0:1776190942.460615:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f5f736f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630828800:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190942.460665:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f5f736f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630828800:12345-0@lo:400:kworker/u8:4.0 Request processed in 47us (151us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190942.460673:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4116
00000100:00100000:2.0:1776190942.460712:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f93569a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630828800:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190942.460725:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000075f8236 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630828736:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190942.461218:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000431a05c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630829184:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190942.461800:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190942.461826:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1776190942.461833:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f93569a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630828992:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190942.461863:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190942.461908:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630828864
00000100:00100000:2.0:1776190942.462558:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2811
00000100:00100000:2.0:1776190942.462563:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae14767e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630828864:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190942.462600:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae14767e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630828864:12345-0@lo:400:kworker/u8:4.0 Request processed in 36us (1667us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190942.462606:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2811
00000100:00100000:2.0:1776190944.091453:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776190945.531336:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630829312
00000100:00100000:2.0:1776190945.531439:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2813
00000100:00100000:2.0:1776190945.531445:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ccb6319 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630829312:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776190945.531477:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776190945.531527:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ccb6319 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630829312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (501us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190945.531533:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2813
00000100:00100000:2.0:1776190946.554360:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001610a176 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630829376:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776190946.554434:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1776190947.579090:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776190947.579097:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776190947.579100:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776190947.579105:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3480
00000100:00080000:2.0:1776190947.579107:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776190947.579110:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776190947.579142:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000074fc7059 x1862467630829888/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776190947.579168:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776190947.579173:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776190947.579175:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776190947.579179:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3480
00000100:00080000:2.0:1776190947.579181:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776190947.579184:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776190947.579208:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000c345c5b9 x1862467630829952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776190947.579266:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000cbdfd62 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630829696:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190947.579320:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190947.579344:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ed5180d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630830080:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190947.579379:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190947.579420:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000073716db5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630829440:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776190947.579441:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:2.0:1776190947.579449:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a2a7dce2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630829632:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190947.579479:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190947.579501:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ce2fb2ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630830016:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190947.579545:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190947.579586:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630829760
00000100:00100000:2.0:1776190947.579618:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630829632
00000100:00100000:2.0:1776190947.579649:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2815
00000100:00100000:2.0:1776190947.579653:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000091b33827 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630829760:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190947.579872:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000091b33827 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630829760:12345-0@lo:400:kworker/u8:4.0 Request processed in 216us (520us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190947.579885:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2815
00000100:00100000:2.0:1776190947.579909:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2816
00000100:00100000:2.0:1776190947.580107:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000073716db5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630829632:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190947.580150:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000073716db5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630829632:12345-0@lo:400:kworker/u8:4.0 Request processed in 43us (672us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190947.588095:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2816
00000100:00100000:2.0:1776190949.225828:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613769600
00000100:00100000:2.0:1776190949.225914:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4126
00000100:00100000:2.0:1776190949.225921:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003b33813c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613769600:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776190949.226782:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003b33813c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613769600:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 858us (15075us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190949.226794:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4126
00000100:00100000:2.0:1776190950.654791:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630830208
00000100:00100000:2.0:1776190950.654844:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2817
00000100:00100000:2.0:1776190950.654850:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc2bbe9c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630830208:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776190950.654881:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776190950.656069:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc2bbe9c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630830208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1213us (1367us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190950.656082:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2817
00000100:00100000:2.0:1776190951.675151:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001610a176 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630830272:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776190951.675223:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190951.676528:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001610a176 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630830272:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776190952.700530:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bf7cf36f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630830464:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190952.700575:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190952.700597:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008ba1222e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630830720:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190952.700658:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190952.700696:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630830464
00000100:00100000:2.0:1776190952.700737:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4128
00000100:00100000:2.0:1776190952.700743:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a34feed9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630830464:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190952.700793:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a34feed9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630830464:12345-0@lo:400:kworker/u8:2.0 Request processed in 49us (218us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190952.700800:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4128
00000100:00100000:2.0:1776190952.700837:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bf7cf36f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630830464:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190952.700869:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630830336
00000100:00100000:2.0:1776190952.700896:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423
00000100:00100000:2.0:1776190952.700900:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007984aea6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630830336:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776190952.700920:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776190952.700964:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007984aea6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630830336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (1021us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190952.700971:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423
00000100:00100000:2.0:1776190952.701002:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007003430f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630830592:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190952.701025:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190952.701058:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003f4bfd6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630830848:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776190952.701092:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190952.701107:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:2.0:1776190952.701112:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de454674 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630830528:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190952.701135:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190952.701149:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027a3109c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630830784:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190952.701170:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190952.701207:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630830848
00000100:00100000:2.0:1776190952.701230:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424
00000100:00100000:2.0:1776190952.701233:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b1b67b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630830848:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776190952.701242:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776190952.701285:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b1b67b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630830848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (193us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190952.701300:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424
00000100:00100000:2.0:1776190952.701316:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630830592
00000100:00100000:2.0:1776190952.701335:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4129
00000100:00100000:2.0:1776190952.701339:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008cc5f0ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630830592:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190952.701367:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008cc5f0ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630830592:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (340us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190952.701374:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4129
00000100:00100000:2.0:1776190952.701410:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007003430f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630830592:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190952.701422:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003f4bfd6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630830848:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776190952.701444:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630830720
00000100:00100000:2.0:1776190952.701466:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630830784
00000100:00100000:2.0:1776190952.701480:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1826
00000100:00100000:2.0:1776190952.701483:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004bce44f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630830720:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190952.701524:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004bce44f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630830720:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (857us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190952.701531:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1826
00000100:00100000:2.0:1776190952.701541:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1827
00000100:00100000:2.0:1776190952.701545:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000034f2f5bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630830784:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190952.701573:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000034f2f5bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630830784:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (402us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190952.701578:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1827
00000100:00100000:2.0:1776190952.701604:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027a3109c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630830784:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190952.701622:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008ba1222e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630830720:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190952.701672:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630830528
00000100:00100000:2.0:1776190952.701694:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2819
00000100:00100000:2.0:1776190952.701698:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006de4f7b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630830528:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190952.701731:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006de4f7b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630830528:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (596us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190952.701736:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2819
00000100:00100000:2.0:1776190952.701756:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de454674 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630830528:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190952.703511:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630830400
00000100:00100000:2.0:1776190952.703558:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1574
00000100:00100000:2.0:1776190952.703562:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fc1666bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630830400:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190952.703603:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fc1666bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630830400:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (1599us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190952.703610:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1574
00000100:00100000:2.0:1776190952.707091:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630831104
00000100:00100000:2.0:1776190952.707135:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4131
00000100:00100000:2.0:1776190952.707141:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f17e505c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630831104:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190952.707214:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f17e505c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630831104:12345-0@lo:400:kworker/u8:2.0 Request processed in 72us (282us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190952.707221:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4131
00000100:00100000:2.0:1776190954.332070:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4133
00000100:00100000:2.0:1776190954.332077:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f370bd8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613769856:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776190954.336709:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f370bd8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613769856:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 4623us (4940us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190954.336727:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4133
00000100:00100000:2.0:1776190955.775089:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000059d0f50d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630831168:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776190956.794444:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001d7d2914 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630831232:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776190956.794511:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190957.818246:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000698fe8e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630831360:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776190957.818312:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190957.821277:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000424d0623 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630831360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2807us (2965us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190957.821294:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425
00000100:00100000:2.0:1776190957.821314:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000059d0f50d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630831616:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190957.821329:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630831296
00000100:00100000:2.0:1776190957.821353:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190957.821371:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426
00000100:00100000:1.0:1776190957.821377:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f2ed044 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630831296:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776190957.821384:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001672005a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630832000:0@lo:400:kworker/u8:4.0
00002000:00000024:1.0:1776190957.821400:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776190957.821420:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190957.821504:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f2ed044 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630831296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (359us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190957.821582:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000698fe8e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630831360:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776190957.822354:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000059d0f50d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630831616:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190957.822366:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001672005a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630832000:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190957.822438:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190957.822466:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc019f4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630831296:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776190957.822483:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093a782ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630831552:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190957.822502:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630831936
00000100:00100000:2.0:1776190957.822719:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4137
00000100:00100000:2.0:1776190957.822724:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000698fe8e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630831936:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190957.822762:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000698fe8e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630831936:12345-0@lo:400:kworker/u8:4.0 Request processed in 37us (323us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190957.823742:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4137
00000100:00100000:1.0:1776190957.824322:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426
00000100:00100000:2.0:1776190959.451991:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613770176
00000100:00100000:2.0:1776190959.452072:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4138
00000100:00100000:2.0:1776190959.452079:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003824609a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613770176:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776190959.452147:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003824609a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613770176:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 68us (449us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190959.452156:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4138
00000100:00100000:2.0:1776190959.461309:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613770240
00000100:00100000:2.0:1776190959.461489:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4139
00000100:00100000:1.0:1776190959.461496:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613770112
00000100:00100000:2.0:1776190959.461514:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f739a423 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613770240:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776190959.461549:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1577
00000100:00100000:1.0:1776190959.461553:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e58aa936 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613770112:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776190959.461754:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f739a423 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613770240:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 246us (544us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190959.461762:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4139
00000100:00100000:1.0:1776190959.464268:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e58aa936 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613770112:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 2704us (3110us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190959.464284:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1577
00010000:00010000:0.0:1776190960.635462:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776190960.890427:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776190960.890442:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d5dde41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630832064:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776190960.890510:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190960.891424:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d5dde41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630832064:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776190961.658265:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776190961.925765:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1776190961.928306:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d55fd4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630832128:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776190961.928393:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776190961.928641:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630832128
00000100:00100000:0.0:1776190961.928694:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2826
00000100:00100000:0.0:1776190961.928700:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000074fc7059 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630832128:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776190961.928735:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776190961.928826:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000074fc7059 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630832128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (434us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190961.928833:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2826
00000100:00100000:2.0:1776190961.928892:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d55fd4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630832128:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776190962.938278:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1776190962.938313:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ed5180d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630832192:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776190962.938417:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190962.938575:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630832192
00000100:00100000:1.0:1776190962.938630:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427
00000100:00100000:1.0:1776190962.938636:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000cbdfd62 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630832192:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776190962.938664:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776190962.938711:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000cbdfd62 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630832192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (294us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190962.938721:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1427
00000100:00100000:2.0:1776190962.938822:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dcd4c128 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630832256:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776190962.938845:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190962.938881:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ed5180d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630832192:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776190962.938934:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630832256
00000100:00100000:1.0:1776190962.938959:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428
00000100:00100000:1.0:1776190962.938963:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ce2fb2ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630832256:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776190962.938971:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776190962.938994:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ce2fb2ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630832256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 31us (149us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190962.939000:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428
00000100:00100000:2.0:1776190962.939062:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dcd4c128 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630832256:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1776190962.939502:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776190962.939506:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776190962.939509:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776190962.939514:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3495
00000100:00080000:1.0:1776190962.939516:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776190962.939520:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776190962.939936:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630832512
00000100:00100000:2.0:1776190962.939968:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4140
00000100:00100000:2.0:1776190962.939972:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027a3109c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630832512:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190962.940003:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027a3109c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630832512:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (335us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190962.940008:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4140
00000100:00100000:2.0:1776190962.940025:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f5a166e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630832384:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190962.940067:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190962.940082:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:2.0:1776190962.940087:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008a1548b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630832320:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190962.940112:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190962.940129:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0fd09fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630832576:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190962.940146:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190962.940164:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630832384
00000100:00100000:2.0:1776190962.940180:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4141
00000100:00100000:2.0:1776190962.940183:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ed5180d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630832384:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190962.940208:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ed5180d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630832384:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (141us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190962.940213:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4141
00000100:00100000:2.0:1776190962.940232:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f5a166e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630832384:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190962.940263:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630832320
00000100:00100000:2.0:1776190962.940281:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1578
00000100:00100000:2.0:1776190962.940284:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae4705ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630832320:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190962.940323:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae4705ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630832320:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (210us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190962.940328:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1578
00000100:00100000:2.0:1776190962.940352:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008a1548b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630832320:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776190962.940486:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000b2914ae0 x1862467630832640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776190962.940509:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776190962.940512:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776190962.940514:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776190962.940518:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3495
00000100:00080000:1.0:1776190962.940519:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776190962.940522:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776190962.940649:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000ecd900ea x1862467630832704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776190962.941011:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b2914ae0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630832640:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776190962.941060:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190962.941073:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ecd900ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630832704:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776190962.941088:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190962.941110:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a58596b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630832768:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190962.941126:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190962.941141:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0fd09fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630832576:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190962.941158:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630832768
00000100:00100000:2.0:1776190962.941175:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4143
00000100:00100000:2.0:1776190962.941179:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a5d3af6f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630832768:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190962.941203:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a5d3af6f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630832768:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (76us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190962.941208:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4143
00000100:00100000:2.0:1776190962.941226:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a58596b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630832768:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776190962.941655:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2054
00000100:00100000:0.0:1776190962.941660:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad4a7212 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630832704:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776190962.941741:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776190962.942832:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad4a7212 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630832704:12345-0@lo:8:kworker/u8:2.0 Request processed in 1167us (1739us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776190962.942842:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2054
00000100:00080000:2.0:1776190962.943001:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776190962.943005:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776190962.943008:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b2914ae0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630832640:0@lo:8:kworker/u8:2.0
00000100:00080000:2.0:1776190962.943016:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776190962.943019:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776190962.943021:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ecd900ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630832704:0@lo:8:kworker/u8:2.0
00010000:00010000:0.0:1776190963.706351:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776190964.570506:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776190964.570606:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776190964.570637:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776190964.570663:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776190964.570748:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776190964.570782:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613770624
00000100:00100000:0.0:1776190964.570841:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613770688
00000100:00100000:0.0:1776190964.570862:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1831
00000100:00100000:0.0:1776190964.570869:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a81e70bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613770624:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776190964.570948:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a81e70bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613770624:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 77us (283us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190964.570958:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1831
00000100:00100000:0.0:1776190964.570975:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2055
00000100:00100000:0.0:1776190964.570979:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d5dde41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613770688:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:0.0:1776190964.571096:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776190964.571121:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d5dde41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613770688:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 141us (375us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776190964.571128:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2055
00000100:00100000:1.0:1776190964.571282:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613770560
00000100:00100000:1.0:1776190964.571317:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613770496
00000100:00100000:1.0:1776190964.571335:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4144
00000100:00100000:1.0:1776190964.571340:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ca787ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613770560:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776190964.571379:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ca787ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613770560:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 39us (773us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190964.571385:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4144
00000100:00100000:1.0:1776190964.571397:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4145
00000100:00100000:1.0:1776190964.571402:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e56aacf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613770496:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776190964.571424:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e56aacf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613770496:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 22us (788us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190964.571430:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4145
00000100:00100000:2.0:1776190964.571481:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613770432
00000100:00100000:2.0:1776190964.571523:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1579
00000100:00100000:2.0:1776190964.571530:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000deab4b38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613770432:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776190964.572835:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000deab4b38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613770432:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 1299us (2331us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190964.572848:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1579
00010000:00010000:0.0:1776190964.732148:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776190966.010412:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dbd40b9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630832896:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776190966.010499:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190966.010596:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630832896
00000100:00100000:1.0:1776190966.010649:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2829
00000100:00100000:1.0:1776190966.010656:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c5625d66 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630832896:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776190966.010687:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776190966.010756:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c5625d66 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630832896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (258us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190966.010763:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2829
00000100:00100000:2.0:1776190966.010984:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dbd40b9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630832896:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776190966.778672:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776190967.034591:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004831c73f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630832960:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776190967.034670:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776190967.034869:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630832960
00000100:00100000:0.0:1776190967.034922:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2830
00000100:00100000:0.0:1776190967.034928:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001672005a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630832960:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776190967.034963:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776190967.035017:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001672005a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630832960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (347us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190967.035023:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2830
00000100:00100000:2.0:1776190967.035237:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004831c73f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630832960:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776190967.802904:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1776190968.058300:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776190968.058308:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776190968.058312:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776190968.058321:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3501
00000100:00100000:0.0:1776190968.058324:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b92c4097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630833088:0@lo:400:kworker/u8:2.0
00000100:00080000:1.0:1776190968.058326:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776190968.058334:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776190968.058357:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000c0fd09fc x1862467630833472/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776190968.058376:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776190968.058380:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776190968.058381:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776190968.058385:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3501
00000100:00080000:1.0:1776190968.058386:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00100000:0.0:1776190968.058391:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776190968.058394:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776190968.058407:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000a86d26af x1862467630833536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776190968.058432:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b2914ae0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630833344:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776190968.058451:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a96a54e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630833152:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776190968.058458:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190968.058492:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776190968.058502:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630833344
00000100:00100000:1.0:1776190968.058515:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a58596b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630833408:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776190968.058538:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776190968.059101:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630833408
00000100:00100000:0.0:1776190968.059140:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1832
00000100:00100000:0.0:1776190968.059149:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dbd40b9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630833344:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776190968.059214:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dbd40b9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630833344:12345-0@lo:400:kworker/u8:2.0 Request processed in 65us (755us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190968.059220:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4148
00000100:00100000:0.0:1776190968.059229:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1832
00000100:00100000:2.0:1776190968.059233:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005112615a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630833216:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776190968.059250:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1833
00000100:00100000:0.0:1776190968.059258:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae5c256c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630833408:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190968.059276:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005112615a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630833216:12345-0@lo:400:kworker/u8:2.0 Request processed in 45us (543us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190968.059283:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4148
00000100:00100000:0.0:1776190968.059303:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae5c256c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630833408:12345-0@lo:400:kworker/u8:2.0 Request processed in 45us (763us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190968.059314:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1833
00000100:00100000:2.0:1776190968.059316:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630833024
00000100:00100000:2.0:1776190968.059351:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1580
00000100:00100000:0.0:1776190968.059359:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000604d7be5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630833728:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776190968.059359:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a4afbcc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630833024:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776190968.059403:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190968.059416:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a4afbcc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630833024:12345-0@lo:400:kworker/u8:2.0 Request processed in 57us (786us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190968.059426:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1580
00000100:00100000:2.0:1776190968.059503:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0fd09fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630833472:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776190968.059529:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190968.059551:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a86d26af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630833536:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776190968.059594:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190968.059623:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630833472
00000100:00100000:2.0:1776190968.059639:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630833536
00000100:00100000:2.0:1776190968.059652:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2056
00000100:00100000:2.0:1776190968.059655:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000059d0f50d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630833472:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776190968.060010:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a58596b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630833408:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776190968.060027:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093a782ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630833792:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776190968.060086:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2057
00000100:00100000:1.0:1776190968.060089:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000924b81a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630833536:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:1.0:1776190968.060180:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776190968.060225:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000924b81a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630833536:12345-0@lo:8:kworker/u8:2.0 Request processed in 134us (631us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776190968.060231:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2057
00000100:00100000:0.0:1776190968.060343:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b92c4097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630833088:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776190968.060354:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b2914ae0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630833344:0@lo:400:kworker/u8:2.0
00000100:00080000:0.0:1776190968.060395:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776190968.060399:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776190968.060402:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a86d26af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630833536:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776190968.060484:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630833728
00010000:02020000:2.0:1776190968.060495:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776190968.060526:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429
00000100:00100000:1.0:1776190968.060534:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a0236b56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630833728:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776190968.060535:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000059d0f50d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630833472:12345-0@lo:8:kworker/u8:2.0 Request processed in 876us (1003us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776190968.060545:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2056
00002000:00000024:1.0:1776190968.060572:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00080000:0.0:1776190968.060724:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776190968.060728:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776190968.060731:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0fd09fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630833472:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776190968.060757:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776190968.060789:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a96a54e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630833152:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190968.060865:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630833792
00000100:00100000:2.0:1776190968.060897:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430
00000100:00100000:2.0:1776190968.060912:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000012367763 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630833792:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776190968.060924:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776190968.060969:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a0236b56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630833728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 435us (1566us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190968.060975:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000012367763 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630833792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (216us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190968.060982:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429
00000100:00100000:2.0:1776190968.060988:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430
00000100:00100000:2.0:1776190968.061026:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093a782ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630833792:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776190968.061273:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000604d7be5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630833728:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776190969.692168:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776190969.692284:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776190969.692326:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776190969.692360:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613770752
00000100:00100000:0.0:1776190969.692367:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776190969.692405:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776190969.692414:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1581
00000100:00100000:1.0:1776190969.692421:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dbba1dca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613770752:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776190969.692491:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dbba1dca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613770752:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 69us (207us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190969.692499:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1581
00000100:00100000:2.0:1776190969.693219:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613771008
00000100:00100000:2.0:1776190969.693261:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613770944
00000100:00100000:2.0:1776190969.694762:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1834
00000100:00100000:2.0:1776190969.694780:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000059e49ec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613770944:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776190969.694865:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000059e49ec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613770944:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 91us (2461us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190969.694873:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1834
00010000:00010000:0.0:1776190969.852972:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776190970.874342:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776190971.131232:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776190971.131249:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000abb7dbe9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630833856:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776190971.131317:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776190971.131416:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630833856
00000100:00100000:0.0:1776190971.131467:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2833
00000100:00100000:0.0:1776190971.131482:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009a58596b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630833856:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776190971.131514:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776190971.131648:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009a58596b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630833856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 174us (332us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190971.131655:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2833
00000100:00100000:1.0:1776190971.131902:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000abb7dbe9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630833856:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776190972.155737:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630833920
00000100:00100000:0.0:1776190972.155792:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2834
00000100:00100000:0.0:1776190972.155798:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c0278cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630833920:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776190972.155836:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776190972.155893:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c0278cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630833920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (334us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190972.155900:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2834
00000100:00100000:1.0:1776190972.155998:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dcd4c128 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630833920:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776190972.922414:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776190973.178362:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ae1da2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630834048:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1776190973.178370:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776190973.178374:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776190973.178377:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776190973.178381:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3506
00000100:00080000:0.0:1776190973.178383:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776190973.178388:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776190973.178405:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000053bdf8f5 x1862467630834496/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776190973.178416:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776190973.178419:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776190973.178419:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1776190973.178429:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1776190973.178432:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3506
00000100:00080000:0.0:1776190973.178434:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776190973.178436:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776190973.178445:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000047404be6 x1862467630834560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776190973.178465:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ea5b1fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630834304:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190973.178470:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053bdf8f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630834496:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776190973.178497:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776190973.178505:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190973.178516:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000036033aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630834688:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190973.178523:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047404be6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630834560:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776190973.178548:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190973.178552:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190973.178574:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [0->1]
00000100:00100000:0.0:1776190973.178578:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630834496
00000100:00100000:2.0:1776190973.178581:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007a1a9e6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630833984:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190973.178606:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630834560
00000100:00100000:2.0:1776190973.178613:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190973.178629:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9d5bfab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630834240:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190973.178634:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2059
00000100:00100000:0.0:1776190973.178641:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093074f1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630834496:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776190973.178649:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190973.178659:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b4ee822 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630834624:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190973.178674:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190973.178695:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008074d522 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630834112:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190973.178712:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190973.178721:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000079aa8992 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630834368:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190973.178734:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:02020000:0.0:1776190973.178744:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776190973.178751:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:2.0:1776190973.178756:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000615cbccf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630834176:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190973.178786:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190973.178929:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776190973.178937:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dcd4c128 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630834752:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776190973.178974:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093074f1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630834496:12345-0@lo:8:kworker/u8:4.0 Request processed in 333us (470us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776190973.178982:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2059
00000100:00100000:0.0:1776190973.178996:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630834368
00000100:00100000:0.0:1776190973.179018:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1835
00000100:00100000:0.0:1776190973.179021:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009f8cb77f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630834368:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190973.179403:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000010d41dfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630834432:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190973.179428:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190973.179451:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630834432
00000100:00100000:2.0:1776190973.179468:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1836
00000100:00100000:2.0:1776190973.179472:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000746b7981 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630834432:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190973.179503:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000746b7981 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630834432:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (75us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190973.179508:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1836
00000100:00100000:2.0:1776190973.179519:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2060
00000100:00100000:2.0:1776190973.179522:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb7e6216 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630834560:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776190973.179615:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776190973.179638:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb7e6216 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630834560:12345-0@lo:8:kworker/u8:4.0 Request processed in 115us (1089us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776190973.179643:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2060
00000100:00100000:2.0:1776190973.179675:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000010d41dfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630834432:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190973.179714:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630834688
00000100:00100000:2.0:1776190973.179737:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630834240
00000100:00100000:2.0:1776190973.179751:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630834624
00000100:00100000:2.0:1776190973.179767:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630834112
00000100:00100000:0.0:1776190973.180374:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009f8cb77f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630834368:12345-0@lo:400:kworker/u8:4.0 Request processed in 1068us (1355us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190973.180386:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776190973.180389:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1835
00000100:00100000:2.0:1776190973.180394:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4152
00000100:00100000:2.0:1776190973.180405:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007c4b8263 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630834688:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190973.180426:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4153
00000100:00100000:0.0:1776190973.180436:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000352f4840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630834240:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190973.180437:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630833984
00000100:00100000:2.0:1776190973.180450:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007c4b8263 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630834688:12345-0@lo:400:kworker/u8:4.0 Request processed in 46us (1898us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190973.180457:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4152
00000100:00100000:1.0:1776190973.180468:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1582
00000100:00100000:1.0:1776190973.180475:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b9375c8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630833984:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190973.180481:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4154
00000100:00100000:2.0:1776190973.180491:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ab16a8b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630834624:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190973.180492:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000352f4840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630834240:12345-0@lo:400:kworker/u8:4.0 Request processed in 57us (1842us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190973.180501:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b9375c8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630833984:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (1889us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190973.180507:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4153
00000100:00100000:1.0:1776190973.180510:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1582
00000100:00100000:0.0:1776190973.180526:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4155
00000100:00100000:0.0:1776190973.180532:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000785d411c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630834112:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190973.180542:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ab16a8b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630834624:12345-0@lo:400:kworker/u8:4.0 Request processed in 53us (1866us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190973.180550:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4154
00000100:00100000:1.0:1776190973.180562:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630834048
00000100:00100000:0.0:1776190973.180567:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000785d411c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630834112:12345-0@lo:400:kworker/u8:4.0 Request processed in 35us (1854us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190973.180573:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4155
00000100:00100000:1.0:1776190973.180590:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630834752
00000100:00100000:2.0:1776190973.180599:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431
00000100:00100000:2.0:1776190973.180609:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ee2fc84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630834048:12345-0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1776190973.180611:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776190973.180616:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776190973.180624:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053bdf8f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630834496:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776190973.180630:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432
00000100:00100000:1.0:1776190973.180635:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d55fd4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630834752:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776190973.180636:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00080000:0.0:1776190973.180641:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00002000:00000024:1.0:1776190973.180647:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00080000:0.0:1776190973.180648:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776190973.180652:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047404be6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630834560:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776190973.180679:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ee2fc84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630834048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (2250us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190973.180692:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d55fd4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630834752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (916us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190973.180692:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431
00000100:00100000:1.0:1776190973.180703:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432
00000100:00100000:1.0:1776190973.180747:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dcd4c128 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630834752:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776190973.180758:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000615cbccf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630834176:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190973.180775:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008074d522 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630834112:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190973.180785:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000079aa8992 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630834368:0@lo:400:kworker/u8:4.0
00010000:00010000:0.0:1776190973.946568:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776190974.811587:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776190974.811644:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776190974.811668:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776190974.811696:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776190974.811730:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776190974.811738:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613771328
00000100:00100000:1.0:1776190974.811760:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613771072
00000100:00100000:2.0:1776190974.811781:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613771264
00000100:00100000:2.0:1776190974.811809:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1837
00000100:00100000:2.0:1776190974.811815:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001d7d2914 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613771264:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776190974.811894:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001d7d2914 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613771264:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 79us (225us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190974.811953:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1837
00000100:00100000:2.0:1776190974.812025:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2061
00000100:00100000:2.0:1776190974.812030:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dcd4c128 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613771328:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:2.0:1776190974.812178:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776190974.812204:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dcd4c128 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613771328:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 173us (626us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776190974.812210:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2061
00000100:00100000:2.0:1776190974.812232:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613771136
00000100:00100000:2.0:1776190974.812263:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613771200
00000100:00100000:1.0:1776190974.812280:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1583
00000100:00100000:2.0:1776190974.812287:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4156
00000100:00100000:1.0:1776190974.812290:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fec76140 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613771072:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776190974.812297:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fc019f4b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613771136:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776190974.812328:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fec76140 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613771072:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 40us (632us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190974.812335:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fc019f4b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613771136:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 38us (689us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190974.812343:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1583
00000100:00100000:2.0:1776190974.812347:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4156
00000100:00100000:2.0:1776190974.812362:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4157
00000100:00100000:2.0:1776190974.812367:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003f4bfd6c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613771200:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776190974.812393:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003f4bfd6c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613771200:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 26us (663us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190974.812399:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4157
00010000:00010000:0.0:1776190975.994583:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776190976.251919:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047404be6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630834816:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776190976.251990:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776190976.252111:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630834816
00000100:00100000:0.0:1776190976.252163:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2837
00000100:00100000:0.0:1776190976.252169:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001610a176 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630834816:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776190976.252202:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776190976.252251:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001610a176 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630834816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (263us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190976.252258:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2837
00000100:00100000:1.0:1776190976.252380:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047404be6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630834816:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776190977.018917:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776190977.274483:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630834880
00000100:00100000:1.0:1776190977.274534:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2838
00000100:00100000:1.0:1776190977.274549:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dab16da3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630834880:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776190977.274583:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776190977.274633:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dab16da3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630834880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (263us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190977.274640:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2838
00000100:00100000:2.0:1776190978.298305:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0fd09fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630834944:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776190978.298374:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1776190978.298390:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776190978.298397:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776190978.298401:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1776190978.298408:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cea0d9c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630835200:0@lo:400:kworker/u8:4.0
00000100:00080000:0.0:1776190978.298411:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3511
00000100:00080000:0.0:1776190978.298415:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776190978.298421:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776190978.298443:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000a27cd066 x1862467630835456/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776190978.298458:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776190978.298460:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776190978.298462:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776190978.298464:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3511
00000100:00080000:0.0:1776190978.298466:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776190978.298469:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776190978.298553:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000989821a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630835072:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190978.298616:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000bc7ab3d9 x1862467630835584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776190978.298644:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a27cd066 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630835456:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776190978.300371:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190978.300414:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a86d26af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630835520:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776190978.300456:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190978.300556:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:2.0:1776190978.300563:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa646f87 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630835136:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190978.300586:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190978.300601:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011d3c5e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630835392:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190978.300622:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190978.300741:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630834944
00000100:00100000:2.0:1776190978.300782:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630835520
00000100:00100000:2.0:1776190978.300805:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433
00000100:00100000:2.0:1776190978.300810:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002d7eb8c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630834944:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776190978.300835:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776190978.300870:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002d7eb8c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630834944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (2499us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190978.300876:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433
00000100:00100000:2.0:1776190978.300893:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434
00000100:00100000:2.0:1776190978.300897:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c049762 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630835520:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776190978.300904:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776190978.300936:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c049762 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630835520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (480us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190978.300941:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434
00000100:00100000:2.0:1776190978.300971:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630835392
00000100:00100000:2.0:1776190978.300998:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1838
00000100:00100000:2.0:1776190978.301004:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c5a025e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630835392:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190978.301059:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c5a025e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630835392:12345-0@lo:400:kworker/u8:4.0 Request processed in 54us (436us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190978.301069:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1838
00000100:00100000:2.0:1776190978.301129:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011d3c5e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630835392:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190978.301153:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a86d26af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630835520:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776190978.301172:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cea0d9c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630835200:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190978.301188:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0fd09fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630834944:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776190978.301238:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2839
00000100:00100000:2.0:1776190978.301243:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be243e0e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630835136:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190978.301282:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be243e0e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630835136:12345-0@lo:400:kworker/u8:4.0 Request processed in 38us (694us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190978.301288:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2839
00000100:00100000:2.0:1776190978.301326:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa646f87 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630835136:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190978.301370:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630835008
00000100:00100000:2.0:1776190978.301399:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1584
00000100:00100000:2.0:1776190978.301404:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cdaa8581 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630835008:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190978.304446:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190978.304721:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776190978.304745:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc7ab3d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630835584:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776190978.304825:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190978.305003:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d7848e1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630835328:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190978.305065:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190978.305117:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630835584
00000100:00100000:1.0:1776190978.305147:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2062
00000100:00100000:1.0:1776190978.305154:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008074d522 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630835456:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776190978.305250:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776190978.305280:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008074d522 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630835456:12345-0@lo:8:kworker/u8:4.0 Request processed in 126us (841us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776190978.305287:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2062
00000100:00100000:1.0:1776190978.305321:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d7848e1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630835328:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190978.305373:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630835072
00000100:00100000:1.0:1776190978.305405:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4161
00000100:00100000:1.0:1776190978.305411:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b2914ae0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630835072:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190978.305446:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b2914ae0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630835072:12345-0@lo:400:kworker/u8:4.0 Request processed in 35us (727us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190978.305452:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4161
00000100:00100000:1.0:1776190978.305490:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000989821a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630835072:0@lo:400:kworker/u8:4.0
00000100:00080000:0.0:1776190978.306381:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776190978.306386:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776190978.306391:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc7ab3d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630835584:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776190978.306411:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cdaa8581 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630835008:12345-0@lo:400:kworker/u8:4.0 Request processed in 5004us (5777us total) trans 0 rc 0/0
00000100:00080000:0.0:1776190978.306415:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776190978.306418:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776190978.306422:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1584
00000100:00100000:0.0:1776190978.306495:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a27cd066 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630835456:0@lo:8:kworker/u8:4.0
00010000:00010000:0.0:1776190979.066290:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776190979.930528:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776190979.930567:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776190979.930602:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776190979.930639:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776190979.931130:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613771392
00000100:00100000:0.0:1776190979.931166:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1585
00000100:00100000:0.0:1776190979.931170:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009803db2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613771392:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776190979.931205:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009803db2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613771392:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 33us (603us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190979.931211:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1585
00000100:00100000:1.0:1776190979.931491:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613771456
00000100:00100000:1.0:1776190979.931529:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613771520
00000100:00100000:1.0:1776190979.931546:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4162
00000100:00100000:1.0:1776190979.931550:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b69f705b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613771456:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776190979.931582:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b69f705b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613771456:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 31us (1061us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190979.931589:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4162
00000100:00100000:1.0:1776190979.931601:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4163
00000100:00100000:1.0:1776190979.931604:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d7dbbaf2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613771520:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776190979.931625:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d7dbbaf2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613771520:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 20us (987us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190979.931631:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4163
00000100:00100000:2.0:1776190979.933224:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613771648
00000100:00100000:2.0:1776190979.933262:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2064
00000100:00100000:2.0:1776190979.933267:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096baf6e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613771648:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:2.0:1776190979.933363:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776190979.933406:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096baf6e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613771648:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 138us (307us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776190979.933413:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2064
00010000:00010000:0.0:1776190980.090336:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776190981.370754:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a27cd066 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630835776:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776190981.370894:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190981.371677:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630835776
00000100:00100000:2.0:1776190981.371775:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2841
00000100:00100000:2.0:1776190981.371781:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a1548b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630835776:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776190981.371823:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776190981.371882:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a1548b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630835776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (989us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190981.371890:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2841
00000100:00100000:1.0:1776190981.371970:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a27cd066 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630835776:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776190982.141150:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776190982.394394:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776190982.394416:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ecd900ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630835840:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776190982.394487:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190982.394952:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630835840
00000100:00100000:2.0:1776190982.394997:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2842
00000100:00100000:2.0:1776190982.395003:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc7ab3d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630835840:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776190982.395054:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776190982.395110:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc7ab3d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630835840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (623us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190982.395118:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2842
00000100:00100000:1.0:1776190982.395176:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ecd900ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630835840:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776190983.162442:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776190983.418274:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ecd900ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630835968:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776190983.418351:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776190983.418421:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000069c1692e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630835904:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1776190983.418555:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776190983.418562:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776190983.418566:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776190983.418580:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3516
00000100:00080000:0.0:1776190983.418583:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776190983.418588:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776190983.418608:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9d5bfab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630836224:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190983.418619:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000a27cd066 x1862467630836480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776190983.418634:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1776190983.418638:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776190983.418642:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776190983.418644:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776190983.418649:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3516
00000100:00080000:0.0:1776190983.418650:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00100000:2.0:1776190983.418653:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00080000:0.0:1776190983.418655:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776190983.418662:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b4ee822 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630836160:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190983.418668:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000053bdf8f5 x1862467630836544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776190983.418688:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190983.418705:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000abb7dbe9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630836416:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190983.418714:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776190983.418725:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d7848e1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630836672:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190983.418731:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190983.418753:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000989821a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630836608:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190983.418772:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190983.418787:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630836416
00000100:00100000:0.0:1776190983.418814:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630836224
00000100:00100000:2.0:1776190983.418818:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1841
00000100:00100000:2.0:1776190983.418823:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029e81afd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630836416:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190983.418850:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630836096
00000100:00100000:2.0:1776190983.418869:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029e81afd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630836416:12345-0@lo:400:kworker/u8:4.0 Request processed in 29us (123us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190983.418875:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1841
00000100:00100000:2.0:1776190983.418897:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190983.418920:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000036033aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630836032:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190983.418943:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630836352
00000100:00100000:2.0:1776190983.418962:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1842
00000100:00100000:2.0:1776190983.418966:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c8cf6d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630836352:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190983.418987:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c8cf6d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630836352:12345-0@lo:400:kworker/u8:4.0 Request processed in 21us (90us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190983.418994:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1842
00000100:00100000:0.0:1776190983.420052:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630836672
00000100:00100000:0.0:1776190983.420091:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4164
00000100:00100000:0.0:1776190983.420097:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d2e07ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630836224:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190983.420142:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d2e07ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630836224:12345-0@lo:400:kworker/u8:4.0 Request processed in 44us (1509us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190983.420149:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4164
00000100:00100000:0.0:1776190983.420161:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4165
00000100:00100000:0.0:1776190983.420165:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d06252d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630836096:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190983.420199:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d06252d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630836096:12345-0@lo:400:kworker/u8:4.0 Request processed in 32us (1499us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190983.420208:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4165
00000100:00100000:0.0:1776190983.420217:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4166
00000100:00100000:0.0:1776190983.420220:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001db836ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630836672:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190983.420250:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001db836ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630836672:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (1481us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190983.420255:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4166
00000100:00100000:0.0:1776190983.420296:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190983.422320:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d7848e1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630836672:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190983.422347:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190983.422376:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b4ee822 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630836160:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190983.422386:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000abb7dbe9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630836416:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190983.422397:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9d5bfab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630836224:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190983.422435:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a27cd066 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630836480:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776190983.422476:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190983.422491:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053bdf8f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630836544:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776190983.422509:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190983.422539:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630836480
00000100:00100000:2.0:1776190983.422569:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630836544
00000100:00100000:2.0:1776190983.422585:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2065
00000100:00100000:2.0:1776190983.422590:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ae1da2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630836480:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776190983.422680:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776190983.422716:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ae1da2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630836480:12345-0@lo:8:kworker/u8:4.0 Request processed in 125us (239us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776190983.422723:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2065
00000100:00100000:2.0:1776190983.422737:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2066
00000100:00100000:2.0:1776190983.422739:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000604d7be5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630836544:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776190983.422819:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776190983.422844:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000604d7be5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630836544:12345-0@lo:8:kworker/u8:4.0 Request processed in 102us (334us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776190983.422863:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2066
00000100:00080000:2.0:1776190983.422888:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776190983.422891:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776190983.422894:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a27cd066 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630836480:0@lo:8:kworker/u8:4.0
00000100:00080000:2.0:1776190983.422901:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776190983.422903:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776190983.422905:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053bdf8f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630836544:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776190983.422947:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630836608
00000100:00100000:2.0:1776190983.422977:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4167
00000100:00100000:2.0:1776190983.422981:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ac3eb660 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630836608:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190983.423577:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630835968
00000100:00100000:0.0:1776190983.423605:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630835904
00000100:00100000:0.0:1776190983.423622:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435
00000100:00100000:0.0:1776190983.423626:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003ac71d2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630835968:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776190983.423648:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776190983.423686:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003ac71d2b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630835968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (5336us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190983.423692:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435
00000100:00100000:0.0:1776190983.423704:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436
00000100:00100000:0.0:1776190983.423707:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa646f87 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630835904:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776190983.423717:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776190983.423742:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa646f87 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630835904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (3447us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190983.423748:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436
00000100:00100000:0.0:1776190983.423786:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000069c1692e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630835904:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776190983.427404:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ac3eb660 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630836608:12345-0@lo:400:kworker/u8:4.0 Request processed in 4414us (5049us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190983.427419:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4167
00000100:00100000:2.0:1776190983.427483:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000989821a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630836608:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190983.427508:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ecd900ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630835968:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776190985.059636:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776190985.059687:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776190985.059749:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776190985.059772:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613771712
00000100:00100000:0.0:1776190985.059852:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1587
00000100:00100000:0.0:1776190985.059861:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ea43294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613771712:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776190985.059861:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613771840
00000100:00100000:1.0:1776190985.059896:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4168
00000100:00100000:1.0:1776190985.059902:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d2e73071 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613771840:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776190985.059944:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ea43294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613771712:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 81us (254us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190985.059952:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1587
00000100:00100000:1.0:1776190985.060213:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d2e73071 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613771840:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 39us (194us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190985.060221:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4168
00000100:00100000:2.0:1776190985.065856:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776190985.065951:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776190985.067222:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613771776
00000100:00100000:1.0:1776190985.067274:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4169
00000100:00100000:1.0:1776190985.067279:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000116bffbd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613771776:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776190985.067332:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000116bffbd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613771776:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 52us (1485us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190985.067339:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4169
00010000:00010000:0.0:1776190985.211892:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776190986.237879:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776190986.490985:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630836736
00000100:00100000:0.0:1776190986.491050:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2845
00000100:00100000:0.0:1776190986.491056:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070c80d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630836736:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776190986.491088:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776190986.491144:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070c80d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630836736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (613us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190986.491151:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2845
00000100:00100000:2.0:1776190986.491538:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cea0d9c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630836736:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776190987.514938:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000a8a89e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630836800:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776190987.515011:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776190987.515203:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630836800
00000100:00100000:0.0:1776190987.515256:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2846
00000100:00100000:0.0:1776190987.515261:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000051374a14 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630836800:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776190987.515294:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776190987.516172:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000051374a14 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630836800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 907us (1160us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190987.516181:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2846
00000100:00100000:2.0:1776190987.518743:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000a8a89e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630836800:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776190988.282377:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776190988.538455:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776190988.538469:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043db582c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630836864:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776190988.538550:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776190988.538686:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d20676ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630836928:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776190988.538719:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190988.538810:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630836864
00000100:00100000:2.0:1776190988.538857:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437
00000100:00100000:2.0:1776190988.538863:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000011d3c5e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630836864:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776190988.538891:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776190988.538935:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000011d3c5e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630836864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (385us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190988.538943:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437
00000100:00100000:2.0:1776190988.539003:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fd82c1e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630836992:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776190988.539029:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776190988.541986:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630836928
00000100:00100000:0.0:1776190988.542064:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1588
00000100:00100000:0.0:1776190988.542071:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d186bef1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630836928:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776190988.543731:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d186bef1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630836928:12345-0@lo:400:kworker/u8:2.0 Request processed in 1655us (5007us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190988.543754:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1588
00000100:00100000:0.0:1776190988.543839:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000043db582c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630836864:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776190988.545733:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fd82c1e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630836992:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776190988.546116:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004831c73f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630837056:0@lo:400:kworker/u8:2.0
00000100:00080000:1.0:1776190988.546121:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776190988.546127:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776190988.546130:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776190988.546135:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3521
00000100:00080000:1.0:1776190988.546138:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776190988.546143:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776190988.546161:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000c0fd09fc x1862467630837312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776190988.546164:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776190988.546178:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776190988.546180:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776190988.546182:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776190988.546185:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3521
00000100:00080000:1.0:1776190988.546187:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776190988.546190:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776190988.546320:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0fd09fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630837312:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776190988.546350:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190988.546382:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630837312
00000100:00100000:2.0:1776190988.546420:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2068
00000100:00100000:2.0:1776190988.546425:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b8bf74db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630837312:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776190988.546520:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776190988.546557:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b8bf74db pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630837312:12345-0@lo:8:kworker/u8:2.0 Request processed in 132us (207us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776190988.546564:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2068
00000100:00100000:0.0:1776190988.553731:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776190988.553759:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d20676ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630837120:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776190988.553820:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000a86d26af x1862467630837376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776190988.553965:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190988.553993:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630837056
00000100:00100000:0.0:1776190988.554006:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a96a54e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630837440:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776190988.554051:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190988.554066:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630837184
00000100:00100000:0.0:1776190988.554073:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776190988.554080:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7fc0454 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630837504:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776190988.554091:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630837440
00000100:00100000:0.0:1776190988.554107:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190988.554122:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630837504
00000100:00100000:1.0:1776190988.554661:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4170
00000100:00100000:1.0:1776190988.554667:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000047404be6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630837056:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776190988.554806:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000047404be6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630837056:12345-0@lo:400:kworker/u8:2.0 Request processed in 56us (8564us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190988.554816:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4170
00000100:00100000:1.0:1776190988.554834:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4171
00000100:00100000:1.0:1776190988.554837:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ff832465 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630837184:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776190988.554865:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ff832465 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630837184:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (8240us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190988.554871:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4171
00000100:00100000:1.0:1776190988.554880:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4172
00000100:00100000:1.0:1776190988.554883:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000059e49ec2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630837440:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190988.556184:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4173
00000100:00100000:2.0:1776190988.556193:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000929f088f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630837504:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776190988.556255:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000929f088f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630837504:12345-0@lo:400:kworker/u8:2.0 Request processed in 62us (2149us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190988.556262:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4173
00000100:00100000:2.0:1776190988.556301:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a86d26af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630837376:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776190988.556322:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000059e49ec2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630837440:12345-0@lo:400:kworker/u8:2.0 Request processed in 1436us (2270us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190988.556342:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190988.556344:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4172
00000100:00100000:1.0:1776190988.556374:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630837120
00000100:00100000:1.0:1776190988.556417:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2848
00000100:00100000:1.0:1776190988.556421:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000079aa8992 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630837120:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776190988.556615:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7fc0454 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630837504:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776190988.556627:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a96a54e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630837440:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776190988.556637:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004831c73f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630837056:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776190988.556791:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630837376
00000100:00100000:0.0:1776190988.556817:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2069
00000100:00100000:0.0:1776190988.556823:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006eae40ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630837376:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776190988.556844:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000079aa8992 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630837120:12345-0@lo:400:kworker/u8:2.0 Request processed in 421us (2879us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190988.556852:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2848
00000100:00100000:1.0:1776190988.556881:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d20676ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630837120:0@lo:400:kworker/u8:2.0
00010000:02020000:0.0:1776190988.556916:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776190988.556947:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006eae40ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630837376:12345-0@lo:8:kworker/u8:2.0 Request processed in 123us (608us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776190988.556953:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2069
00000100:00080000:2.0:1776190988.557070:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776190988.557074:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776190988.557078:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0fd09fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630837312:0@lo:8:kworker/u8:2.0
00000100:00080000:2.0:1776190988.557097:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776190988.557099:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776190988.557102:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a86d26af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630837376:0@lo:8:kworker/u8:2.0
00010000:00010000:0.0:1776190989.306200:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776190990.175099:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776190990.175141:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776190990.175178:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776190990.175214:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776190990.175827:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613772096
00000100:00100000:0.0:1776190990.175869:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613772160
00000100:00100000:0.0:1776190990.175890:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4174
00000100:00100000:0.0:1776190990.175894:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000290b339 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613772096:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776190990.175927:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000290b339 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613772096:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 32us (836us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190990.175934:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4174
00000100:00100000:0.0:1776190990.175945:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4175
00000100:00100000:0.0:1776190990.175949:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000524f94ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613772160:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776190990.175967:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000524f94ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613772160:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 17us (753us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190990.175973:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4175
00000100:00100000:1.0:1776190990.176625:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613772224
00000100:00100000:1.0:1776190990.176667:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1844
00000100:00100000:1.0:1776190990.176672:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc0a67c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613772224:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776190990.176731:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc0a67c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613772224:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 59us (1590us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190990.176738:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1844
00000100:00100000:1.0:1776190990.178993:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613772288
00000100:00100000:1.0:1776190990.179026:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2070
00000100:00100000:1.0:1776190990.179059:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000301f1ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613772288:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:1.0:1776190990.179158:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776190990.179215:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000301f1ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613772288:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 182us (557us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776190990.179223:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2070
00010000:00010000:0.0:1776190991.355891:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776190991.610955:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1776190991.610971:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc7ab3d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630837568:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776190991.611053:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190991.611146:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630837568
00000100:00100000:1.0:1776190991.611241:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2849
00000100:00100000:1.0:1776190991.611247:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007efd3245 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630837568:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776190991.611277:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776190991.611329:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007efd3245 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630837568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (276us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190991.611335:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2849
00000100:00100000:0.0:1776190991.611668:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc7ab3d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630837568:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776190992.381933:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776190992.635161:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776190992.635179:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d20676ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630837632:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776190992.635264:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190992.640733:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d20676ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630837632:0@lo:41:osp-pre-0-1.0
00000100:00080000:0.0:1776190993.658760:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776190993.658767:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776190993.658771:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776190993.658779:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3526
00000100:00080000:0.0:1776190993.658782:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776190993.658788:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776190993.658806:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000053bdf8f5 x1862467630838144/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776190993.658819:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776190993.658822:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776190993.658823:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776190993.658826:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3526
00000100:00080000:0.0:1776190993.658828:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776190993.658830:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776190993.658839:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000a27cd066 x1862467630838208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776190993.658883:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008074d522 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630837888:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190993.658947:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776190993.658973:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9d5bfab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630838272:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190993.658992:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776190993.659009:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:0.0:1776190993.659014:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fb7e6216 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630837824:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190993.659055:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776190993.659067:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000989821a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630838080:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190993.659103:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776190993.659134:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630837888
00000100:00100000:0.0:1776190993.659167:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630838272
00000100:00100000:0.0:1776190993.659184:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4176
00000100:00100000:0.0:1776190993.659190:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b4ee822 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630837888:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190993.659248:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b4ee822 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630837888:12345-0@lo:400:kworker/u8:4.0 Request processed in 58us (302us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190993.659258:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4176
00000100:00100000:0.0:1776190993.659283:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4177
00000100:00100000:0.0:1776190993.659286:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d7848e1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630838272:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190993.659311:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d7848e1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630838272:12345-0@lo:400:kworker/u8:4.0 Request processed in 24us (319us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190993.659316:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4177
00000100:00100000:0.0:1776190993.659335:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630838080
00000100:00100000:0.0:1776190993.659369:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1845
00000100:00100000:0.0:1776190993.659373:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a1a9e6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630838080:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190993.659400:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a1a9e6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630838080:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (298us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190993.659406:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1845
00000100:00100000:0.0:1776190993.659444:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000989821a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630838080:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190993.659454:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008074d522 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630837888:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190993.659463:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9d5bfab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630838272:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190993.660261:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc7ab3d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630837696:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190993.660317:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190993.660352:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000615cbccf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630837952:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190993.660376:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190993.660393:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000abb7dbe9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630838336:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190993.660415:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190993.660437:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:1.0:1776190993.660443:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093074f1e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630837760:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190993.660462:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190993.660475:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cea0d9c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630838016:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190993.660497:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190993.660527:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630837824
00000100:00100000:1.0:1776190993.660559:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630837952
00000100:00100000:1.0:1776190993.660574:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2851
00000100:00100000:1.0:1776190993.660578:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ea5b1fb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630837824:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190993.660620:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ea5b1fb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630837824:12345-0@lo:400:kworker/u8:4.0 Request processed in 41us (1565us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190993.660627:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2851
00000100:00100000:1.0:1776190993.660652:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2852
00000100:00100000:1.0:1776190993.660655:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003af595e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630837952:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190993.660696:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003af595e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630837952:12345-0@lo:400:kworker/u8:4.0 Request processed in 40us (320us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190993.660701:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2852
00000100:00100000:1.0:1776190993.660718:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630838336
00000100:00100000:1.0:1776190993.660738:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630837760
00000100:00100000:1.0:1776190993.660754:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4178
00000100:00100000:1.0:1776190993.660758:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae5c256c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630838336:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190993.660785:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae5c256c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630838336:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (370us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190993.660791:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4178
00000100:00100000:1.0:1776190993.660802:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4179
00000100:00100000:1.0:1776190993.660805:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ccb6319 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630837760:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190993.660829:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ccb6319 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630837760:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (367us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190993.660834:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4179
00000100:00100000:2.0:1776190993.661479:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053bdf8f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630838144:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776190993.661514:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190993.661536:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a27cd066 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630838208:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776190993.661554:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190993.661585:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630838016
00000100:00100000:2.0:1776190993.661615:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630838144
00000100:00100000:2.0:1776190993.661641:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630838208
00000100:00100000:2.0:1776190993.661654:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1846
00000100:00100000:2.0:1776190993.661658:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048e1f2c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630838016:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776190993.661840:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048e1f2c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630838016:12345-0@lo:400:kworker/u8:4.0 Request processed in 180us (1341us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190993.661846:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1846
00000100:00100000:2.0:1776190993.662522:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2071
00000100:00100000:2.0:1776190993.662528:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000080311080 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630838144:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776190993.662625:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776190993.663146:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093074f1e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630837760:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190993.663159:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cea0d9c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630838016:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190993.663170:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000615cbccf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630837952:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190993.663179:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000abb7dbe9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630838336:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190993.663302:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630837696
00000100:00100000:0.0:1776190993.663338:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1590
00000100:00100000:0.0:1776190993.663342:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008cbd400d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630837696:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190993.663397:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008cbd400d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630837696:12345-0@lo:400:kworker/u8:4.0 Request processed in 54us (3080us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190993.663404:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1590
00000100:00100000:2.0:1776190993.667544:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000080311080 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630838144:12345-0@lo:8:kworker/u8:4.0 Request processed in 5006us (6020us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776190993.667562:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2071
00000100:00100000:2.0:1776190993.667708:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630838400
00000100:00100000:2.0:1776190993.667757:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439
00000100:00100000:2.0:1776190993.667763:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070c80d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630838400:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776190993.667794:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776190993.667860:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070c80d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630838400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (4980us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190993.667866:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439
00000100:00100000:2.0:1776190993.667966:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001bf5e7c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630838400:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776190993.671368:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630838464
00000100:00100000:2.0:1776190993.671420:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440
00000100:00100000:2.0:1776190993.671426:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002c9bae2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630838464:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776190993.671449:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776190993.671495:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002c9bae2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630838464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (843us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190993.671501:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440
00000100:00080000:1.0:1776190993.674956:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776190993.674965:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776190993.674972:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053bdf8f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630838144:0@lo:8:kworker/u8:4.0
00000100:00080000:1.0:1776190993.674997:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776190993.674999:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776190993.675002:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a27cd066 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630838208:0@lo:8:kworker/u8:4.0
00010000:00010000:0.0:1776190994.426695:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776190995.292814:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613772352
00000100:00100000:2.0:1776190995.292850:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1591
00000100:00100000:2.0:1776190995.292854:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000afc79a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613772352:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776190995.292882:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000afc79a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613772352:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 26us (638us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190995.292888:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1591
00000100:00100000:1.0:1776190995.292933:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613772480
00000100:00100000:1.0:1776190995.292968:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613772416
00000100:00100000:2.0:1776190995.292979:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4180
00000100:00100000:2.0:1776190995.292990:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000025d8d2e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613772480:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776190995.293019:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000025d8d2e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613772480:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 34us (720us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190995.294450:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4181
00000100:00100000:1.0:1776190995.294461:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006be09a24 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613772416:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776190995.294562:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006be09a24 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613772416:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 102us (2232us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190995.294572:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4181
00000100:00100000:2.0:1776190995.296124:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4180
00010000:00010000:0.0:1776190995.452630:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776190996.738732:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630838528
00000100:00100000:0.0:1776190996.738792:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2853
00000100:00100000:0.0:1776190996.738797:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c1848a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630838528:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776190996.738830:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776190996.750365:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c1848a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630838528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 11549us (11691us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190996.750381:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2853
00010000:00010000:0.0:1776190997.498195:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776190997.756367:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776190997.756387:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000241a0ec2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630838592:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776190997.756451:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190997.756498:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630838592
00000100:00100000:1.0:1776190997.756559:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2854
00000100:00100000:1.0:1776190997.756565:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f5a166e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630838592:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776190997.756598:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776190997.756638:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f5a166e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630838592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (187us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190997.756645:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2854
00000100:00100000:1.0:1776190997.756688:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000241a0ec2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630838592:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776190998.522234:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1776190998.778662:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776190998.778669:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776190998.778672:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776190998.778680:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3531
00000100:00080000:0.0:1776190998.778683:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776190998.778690:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776190998.778711:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000bc7ab3d9 x1862467630839168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776190998.778729:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776190998.778733:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776190998.778736:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1776190998.778736:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089941aa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630838656:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1776190998.778742:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3531
00000100:00080000:0.0:1776190998.778744:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776190998.778747:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776190998.778758:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000fb7e6216 x1862467630839232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776190998.778826:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776190998.778832:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9d5bfab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630838720:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190998.778855:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000010d41dfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630838912:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190998.778874:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190998.778891:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776190998.778896:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000036033aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630838976:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190998.778923:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000abb7dbe9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630839296:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190998.778930:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776190998.778953:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000615cbccf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630839360:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190998.778956:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190998.778982:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:0.0:1776190998.778983:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190998.778991:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000989821a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630838848:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190998.779005:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:0.0:1776190998.779013:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008074d522 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630838784:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190998.779067:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776190998.779082:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a27cd066 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630839040:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190998.779103:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776190998.779132:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630838656
00000100:00100000:0.0:1776190998.779170:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441
00000100:00100000:0.0:1776190998.779176:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000241a0ec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630838656:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776190998.779216:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776190998.779781:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630839040
00000100:00100000:2.0:1776190998.779817:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1848
00000100:00100000:2.0:1776190998.779821:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000076ea9d35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630839040:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190998.782256:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190998.782303:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053bdf8f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630839104:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190998.782350:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190998.782432:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630838976
00000100:00100000:1.0:1776190998.782477:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630838848
00000100:00100000:1.0:1776190998.782491:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2855
00000100:00100000:1.0:1776190998.782496:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cea0d9c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630838976:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190998.783714:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cea0d9c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630838976:12345-0@lo:400:kworker/u8:4.0 Request processed in 77us (3648us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190998.783727:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2855
00000100:00100000:1.0:1776190998.783906:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2856
00000100:00100000:1.0:1776190998.783913:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a1548b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630838848:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190998.784861:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a1548b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630838848:12345-0@lo:400:kworker/u8:4.0 Request processed in 944us (2607us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190998.784872:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2856
00000100:00100000:1.0:1776190998.784942:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000989821a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630838848:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190998.785259:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4183
00000100:00100000:1.0:1776190998.785266:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001610a176 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630839296:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190998.785335:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001610a176 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630839296:12345-0@lo:400:kworker/u8:4.0 Request processed in 68us (6382us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190998.785342:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4183
00000100:00100000:1.0:1776190998.785357:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4184
00000100:00100000:1.0:1776190998.785361:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093074f1e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630839360:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190998.785390:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093074f1e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630839360:12345-0@lo:400:kworker/u8:4.0 Request processed in 29us (6409us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190998.785395:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4184
00000100:00100000:1.0:1776190998.785406:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4185
00000100:00100000:1.0:1776190998.785410:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000924b81a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630838784:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190998.785446:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000924b81a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630838784:12345-0@lo:400:kworker/u8:4.0 Request processed in 35us (6378us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190998.785451:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4185
00000100:00100000:1.0:1776190998.785474:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630838720
00000100:00100000:1.0:1776190998.786608:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1592
00000100:00100000:1.0:1776190998.786616:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003026b1b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630838720:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190998.786672:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003026b1b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630838720:12345-0@lo:400:kworker/u8:4.0 Request processed in 56us (7800us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190998.786679:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1592
00000100:00100000:1.0:1776190998.786747:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000abb7dbe9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630839296:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190998.786961:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008074d522 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630838784:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190998.786972:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9d5bfab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630838720:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190998.786981:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000036033aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630838976:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190998.786990:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000615cbccf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630839360:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190998.787115:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630839104
00000100:00100000:1.0:1776190998.787157:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1849
00000100:00100000:1.0:1776190998.787161:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001d7d2914 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630839104:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190998.787199:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001d7d2914 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630839104:12345-0@lo:400:kworker/u8:4.0 Request processed in 37us (4849us total) trans 0 rc 0/0
00000100:00100000:1.0:1776190998.787205:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1849
00000100:00100000:1.0:1776190998.787268:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc7ab3d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630839168:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776190998.787300:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190998.787315:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fb7e6216 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630839232:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776190998.787333:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776190998.787357:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630839168
00000100:00100000:1.0:1776190998.787374:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630839232
00000100:00100000:1.0:1776190998.787387:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2074
00000100:00100000:1.0:1776190998.787391:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b92c4097 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630839168:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776190998.787489:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776190998.787535:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b92c4097 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630839168:12345-0@lo:8:kworker/u8:4.0 Request processed in 143us (235us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776190998.787541:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2074
00000100:00100000:1.0:1776190998.787552:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2075
00000100:00100000:1.0:1776190998.787555:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d20676ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630839232:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776190998.787634:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776190998.787657:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d20676ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630839232:12345-0@lo:8:kworker/u8:4.0 Request processed in 101us (324us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776190998.787662:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2075
00000100:00080000:1.0:1776190998.787693:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776190998.787697:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776190998.787700:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc7ab3d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630839168:0@lo:8:kworker/u8:4.0
00000100:00080000:1.0:1776190998.787708:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776190998.787710:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776190998.787713:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fb7e6216 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630839232:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776190998.787733:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776190998.787741:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dcd4c128 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630839424:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776190998.788345:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000076ea9d35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630839040:12345-0@lo:400:kworker/u8:4.0 Request processed in 8520us (9239us total) trans 0 rc 0/0
00000100:00100000:2.0:1776190998.788355:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1848
00000100:00100000:2.0:1776190998.788448:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053bdf8f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630839104:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190998.789179:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000241a0ec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630838656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10000us (10353us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190998.789197:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441
00000100:00100000:2.0:1776190998.790954:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089941aa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630838656:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776190998.790970:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776190998.790984:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000010d41dfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630838912:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776190998.791083:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a27cd066 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630839040:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776190998.795674:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630839424
00000100:00100000:0.0:1776190998.795745:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1442
00000100:00100000:0.0:1776190998.795751:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000a8a89e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630839424:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776190998.795926:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776190998.796220:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000a8a89e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630839424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 467us (5251us total) trans 0 rc 0/0
00000100:00100000:0.0:1776190998.796230:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1442
00000100:00100000:1.0:1776190998.801262:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dcd4c128 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630839424:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191000.413766:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613772672
00000100:00100000:1.0:1776191000.413803:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1593
00000100:00100000:1.0:1776191000.413806:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be2451ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613772672:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191000.413835:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be2451ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613772672:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 28us (466us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191000.413840:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1593
00000100:00100000:2.0:1776191000.414271:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613772928
00000100:00100000:2.0:1776191000.414303:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613772864
00000100:00100000:2.0:1776191000.414334:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1850
00000100:00100000:2.0:1776191000.414339:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d1e8454 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613772864:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191000.414367:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d1e8454 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613772864:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 28us (916us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191000.414373:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1850
00000100:00100000:2.0:1776191000.414387:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2076
00000100:00100000:2.0:1776191000.414390:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000321faac3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613772928:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:2.0:1776191000.414661:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191000.414688:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000321faac3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613772928:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 297us (1378us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191000.414695:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2076
00010000:00010000:0.0:1776191000.571774:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191001.594568:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191001.850558:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089941aa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630839488:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191001.850624:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191001.850718:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630839488
00000100:00100000:0.0:1776191001.850766:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2857
00000100:00100000:0.0:1776191001.850772:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dcd4c128 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630839488:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191001.850802:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191001.850854:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dcd4c128 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630839488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (230us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191001.850860:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2857
00000100:00100000:2.0:1776191001.850940:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089941aa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630839488:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191002.875783:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630839552
00000100:00100000:1.0:1776191002.875836:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2858
00000100:00100000:1.0:1776191002.875843:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cec144c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630839552:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191002.875876:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191002.877841:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cec144c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630839552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1990us (2176us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191002.877857:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2858
00010000:00010000:0.0:1776191003.643543:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191003.898340:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007582ba84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630839680:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191003.898424:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191003.898450:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000c128c04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630839936:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191003.898471:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191003.898487:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fd82c1e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630840320:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191003.898508:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191003.898540:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [0->1]
00000100:00100000:2.0:1776191003.898546:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ecd900ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630839616:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191003.898569:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ca7e4d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630840128:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191003.898574:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191003.898599:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002ae10efb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630839872:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191003.898615:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191003.898624:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191003.898641:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000911fdeb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630840192:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191003.898645:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000096baf6e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630840256:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191003.898681:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191003.898683:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191003.898731:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a86d26af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630840384:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191003.900058:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2077
00000100:00100000:1.0:1776191003.900066:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0fd09fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630840128:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:1.0:1776191003.900165:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191003.900227:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0fd09fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630840128:12345-0@lo:8:kworker/u8:2.0 Request processed in 160us (1614us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191003.900234:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2077
00000100:00100000:1.0:1776191003.900254:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2078
00000100:00100000:1.0:1776191003.900258:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004831c73f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630840192:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191003.900285:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:02020000:1.0:1776191003.900418:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191003.900447:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004831c73f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630840192:12345-0@lo:8:kworker/u8:2.0 Request processed in 188us (1771us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191003.900456:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2078
00000100:00080000:1.0:1776191003.900494:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191003.900499:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191003.900501:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630839616
00000100:00100000:1.0:1776191003.900504:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ca7e4d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630840128:0@lo:8:kworker/u8:2.0
00000100:00080000:1.0:1776191003.900516:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191003.900518:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191003.900520:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000911fdeb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630840192:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191003.900562:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630840384
00000100:00100000:1.0:1776191003.900593:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1443
00000100:00100000:1.0:1776191003.900597:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e63aab7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630840384:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191003.900623:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191003.900658:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e63aab7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630840384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (375us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191003.900664:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1443
00000100:00100000:0.0:1776191003.900699:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444
00000100:00100000:0.0:1776191003.900704:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003bf38be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3364:x1862467630839616:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191003.900716:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191003.900747:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003bf38be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3364:x1862467630839616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (2173us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191003.900753:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444
00000100:00100000:2.0:1776191003.901015:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007582ba84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630839680:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191003.901057:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ecd900ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630839616:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191003.901083:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630839808
00000100:00100000:2.0:1776191003.901109:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630839936
00000100:00100000:2.0:1776191003.901122:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2859
00000100:00100000:2.0:1776191003.901126:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad5119bd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630839808:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191003.901161:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad5119bd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630839808:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (2728us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191003.901166:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2859
00000100:00100000:2.0:1776191003.901177:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2860
00000100:00100000:2.0:1776191003.901181:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000053a7c6a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630839936:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191003.901211:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000053a7c6a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630839936:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (2740us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191003.901216:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2860
00000100:00100000:2.0:1776191003.901235:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630840320
00000100:00100000:2.0:1776191003.901262:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630839872
00000100:00100000:2.0:1776191003.901279:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630840256
00000100:00100000:2.0:1776191003.901296:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4188
00000100:00100000:2.0:1776191003.901299:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d7f603e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630840320:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191003.901344:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d7f603e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630840320:12345-0@lo:400:kworker/u8:2.0 Request processed in 43us (2835us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191003.901350:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4188
00000100:00100000:2.0:1776191003.901360:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4189
00000100:00100000:2.0:1776191003.901364:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d6058b34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630839872:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191003.901387:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d6058b34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630839872:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (2764us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191003.901392:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4189
00000100:00100000:2.0:1776191003.901402:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4190
00000100:00100000:2.0:1776191003.901405:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b40dc6b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630840256:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191003.901465:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b40dc6b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630840256:12345-0@lo:400:kworker/u8:2.0 Request processed in 59us (2787us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191003.901470:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4190
00000100:00100000:1.0:1776191003.902053:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a86d26af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630840384:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191003.902120:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191003.902145:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000636d25c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630840000:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191003.902147:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630839744
00000100:00100000:0.0:1776191003.902180:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4191
00000100:00100000:1.0:1776191003.902185:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191003.902188:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a86d26af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630839744:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191003.902215:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000d20c9eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630839808:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191003.902236:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a86d26af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630839744:12345-0@lo:400:kworker/u8:2.0 Request processed in 48us (116us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191003.902241:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001bc0bbec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630839744:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191003.902247:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4191
00000100:00100000:0.0:1776191003.902288:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630840000
00000100:00100000:0.0:1776191003.902306:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1852
00000100:00100000:2.0:1776191003.902509:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002ae10efb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630839872:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191003.902666:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a96a54e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630840000:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191003.902703:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000096baf6e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630840256:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191003.902740:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a96a54e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630840000:12345-0@lo:400:kworker/u8:2.0 Request processed in 75us (558us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191003.902746:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1852
00000100:00100000:0.0:1776191003.902781:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000636d25c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630840000:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191003.903004:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fd82c1e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630840320:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191003.903015:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000c128c04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630839936:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191003.906941:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000934a8884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630840064:0@lo:400:kworker/u8:2.0
00010000:00010000:0.0:1776191004.666601:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191005.530865:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613773184
00000100:00100000:0.0:1776191005.530922:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1853
00000100:00100000:0.0:1776191005.530929:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000075f8236 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613773184:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191005.530995:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000075f8236 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613773184:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 65us (290us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191005.531002:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1853
00000100:00100000:2.0:1776191005.531637:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613772992
00000100:00100000:2.0:1776191005.531733:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1595
00000100:00100000:2.0:1776191005.531738:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081b9520e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613772992:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191005.531784:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081b9520e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613772992:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 45us (1034us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191005.531791:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1595
00000100:00100000:1.0:1776191005.541919:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613773056
00000100:00100000:1.0:1776191005.542013:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613773120
00000100:00100000:1.0:1776191005.542064:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4192
00000100:00100000:1.0:1776191005.542071:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019361fa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613773056:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191005.544050:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019361fa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613773056:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 1977us (13465us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191005.544061:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4192
00010000:00010000:0.0:1776191006.714256:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191006.970253:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000fc4ac59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630840448:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191006.970333:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191006.970755:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000fc4ac59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630840448:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191007.738659:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191007.994445:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eb0e72b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630840512:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191007.994514:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191008.002952:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eb0e72b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630840512:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191009.018249:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776191009.018274:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ff8853cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630840576:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191009.018354:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191009.018414:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630840576
00000100:00100000:2.0:1776191009.018463:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445
00000100:00100000:2.0:1776191009.018471:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000becbf456 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630840576:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191009.018502:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191009.018550:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000becbf456 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630840576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (199us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191009.018559:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445
00000100:00100000:2.0:1776191009.018616:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ff8853cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630840576:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191009.030242:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630840832
00000100:00100000:1.0:1776191009.030330:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2863
00000100:00100000:1.0:1776191009.030336:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000fc0c826 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630840832:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191009.030419:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000fc0c826 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630840832:12345-0@lo:400:kworker/u8:2.0 Request processed in 82us (3484us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191009.030425:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2863
00000100:00100000:1.0:1776191009.030467:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ff8853cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630840832:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191009.032621:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00080000:2.0:1776191009.032653:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191009.032658:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191009.032661:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191009.032681:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3541
00000100:00080000:2.0:1776191009.032683:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191009.032690:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191009.032724:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000089941aa0 x1862467630841024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191009.032762:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191009.032778:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191009.032780:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191009.032783:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3541
00000100:00080000:2.0:1776191009.032796:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191009.032799:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191009.032810:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000001bf5e7c0 x1862467630841088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191009.032866:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000567d6097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630841152:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191009.032935:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191009.032983:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776191009.032989:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051374a14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630841216:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191009.033074:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191009.033121:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630841152
00000100:00100000:2.0:1776191009.034464:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630841216
00000100:00100000:2.0:1776191009.034504:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4196
00000100:00100000:2.0:1776191009.034510:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000043db582c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630841152:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191009.034618:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000043db582c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630841152:12345-0@lo:400:kworker/u8:2.0 Request processed in 107us (1683us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191009.034625:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4196
00000100:00100000:2.0:1776191009.034663:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4197
00000100:00100000:2.0:1776191009.034667:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ff8853cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630841216:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191009.034725:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ff8853cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630841216:12345-0@lo:400:kworker/u8:2.0 Request processed in 57us (1652us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191009.034745:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4197
00000100:00100000:2.0:1776191009.034817:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051374a14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630841216:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191009.034829:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000567d6097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630841152:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191009.034933:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089941aa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630841024:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191009.035009:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191009.035098:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001bf5e7c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630841088:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191009.035162:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191009.035467:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630841024
00000100:00100000:2.0:1776191009.035500:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630841088
00000100:00100000:2.0:1776191009.035516:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2080
00000100:00100000:2.0:1776191009.035537:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e7fc0454 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630841024:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191009.035691:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191009.035737:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e7fc0454 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630841024:12345-0@lo:8:kworker/u8:2.0 Request processed in 200us (739us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191009.035759:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2080
00000100:00100000:2.0:1776191009.035781:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2081
00000100:00100000:2.0:1776191009.035785:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ecd900ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630841088:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191009.035878:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191009.035900:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ecd900ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630841088:12345-0@lo:8:kworker/u8:2.0 Request processed in 114us (739us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191009.035906:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2081
00000100:00080000:1.0:1776191009.038107:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191009.038117:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191009.038123:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089941aa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630841024:0@lo:8:kworker/u8:2.0
00000100:00080000:1.0:1776191009.038133:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191009.038135:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191009.038136:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001bf5e7c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630841088:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191009.039341:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000fc4ac59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630840960:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191009.039413:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191009.046105:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000fc4ac59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630840960:0@lo:400:kworker/u8:2.0
00010000:00010000:0.0:1776191009.786350:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191010.656808:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613773312
00000100:00100000:2.0:1776191010.656843:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1597
00000100:00100000:2.0:1776191010.656849:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085b2d193 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613773312:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191010.656892:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085b2d193 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613773312:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 36us (447us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191010.656903:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1597
00000100:00100000:2.0:1776191010.661196:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191010.661311:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613773568
00000100:00100000:0.0:1776191010.661363:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2082
00000100:00100000:0.0:1776191010.661370:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000567d6097 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613773568:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:0.0:1776191010.661469:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191010.661532:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000567d6097 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613773568:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 162us (344us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191010.661539:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2082
00010000:00010000:0.0:1776191010.810891:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191011.834309:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191012.090565:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630841280
00000100:00100000:2.0:1776191012.090627:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2865
00000100:00100000:2.0:1776191012.090633:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004bce44f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630841280:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191012.090666:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191012.090733:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004bce44f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630841280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (268us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191012.090740:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2865
00010000:00010000:0.0:1776191012.861426:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191013.115061:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630841344
00000100:00100000:2.0:1776191013.115108:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2866
00000100:00100000:2.0:1776191013.115115:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000034f2f5bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630841344:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191013.115162:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191013.115270:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000034f2f5bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630841344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 152us (423us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191013.115277:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2866
00010000:00010000:0.0:1776191013.882538:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191014.138564:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191014.138581:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000934a8884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630841408:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191014.138658:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191014.138709:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630841408
00000100:00100000:1.0:1776191014.138755:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447
00000100:00100000:1.0:1776191014.138761:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000c128c04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630841408:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191014.138793:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191014.138834:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000c128c04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630841408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (177us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191014.138840:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447
00000100:00100000:1.0:1776191014.138881:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000934a8884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630841408:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1776191014.139020:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191014.139025:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191014.139028:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191014.139053:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3547
00000100:00080000:0.0:1776191014.139056:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191014.139060:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191014.139079:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000069c1692e x1862467630841856/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191014.139095:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191014.139097:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191014.139098:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191014.139101:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3547
00000100:00080000:0.0:1776191014.139102:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191014.139105:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191014.139116:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000083bd922b x1862467630841920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191014.139151:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000069c1692e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630841856:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191014.139200:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191014.139219:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000083bd922b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630841920:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191014.139239:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191014.139266:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630841856
00000100:00100000:0.0:1776191014.139288:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630841920
00000100:00100000:0.0:1776191014.139303:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2083
00000100:00100000:0.0:1776191014.139307:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd716f95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630841856:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191014.139402:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191014.139435:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd716f95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630841856:12345-0@lo:8:kworker/u8:4.0 Request processed in 126us (236us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191014.139441:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2083
00000100:00100000:0.0:1776191014.139454:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2084
00000100:00100000:0.0:1776191014.139457:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8b8f221 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630841920:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191014.139536:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191014.139560:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8b8f221 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630841920:12345-0@lo:8:kworker/u8:4.0 Request processed in 102us (320us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191014.139565:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2084
00000100:00080000:0.0:1776191014.139607:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191014.139610:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191014.139614:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000069c1692e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630841856:0@lo:8:kworker/u8:4.0
00000100:00080000:0.0:1776191014.139621:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191014.139624:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191014.139626:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000083bd922b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630841920:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191014.139646:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eea60842 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630841600:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191014.139671:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191014.139686:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc2a3d25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630841984:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191014.139708:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191014.139725:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:0.0:1776191014.139730:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005c5a025e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630841536:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191014.139748:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191014.139760:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ae1da2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630841792:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191014.139780:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191014.139806:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630841984
00000100:00100000:0.0:1776191014.139831:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630841536
00000100:00100000:0.0:1776191014.139846:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4200
00000100:00100000:0.0:1776191014.139850:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae14767e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630841984:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191014.139889:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae14767e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630841984:12345-0@lo:400:kworker/u8:4.0 Request processed in 37us (180us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191014.139895:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4200
00000100:00100000:0.0:1776191014.139907:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4201
00000100:00100000:0.0:1776191014.139910:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000091b33827 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630841536:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191014.139934:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000091b33827 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630841536:12345-0@lo:400:kworker/u8:4.0 Request processed in 22us (185us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191014.139940:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4201
00000100:00100000:0.0:1776191014.139955:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630841792
00000100:00100000:0.0:1776191014.139975:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1855
00000100:00100000:0.0:1776191014.139979:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc2bbe9c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630841792:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191014.140005:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc2bbe9c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630841792:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (226us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191014.140011:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1855
00000100:00100000:0.0:1776191014.140058:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005c5a025e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630841536:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191014.140070:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ae1da2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630841792:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191014.140077:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc2a3d25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630841984:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191014.140278:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630841600
00000100:00100000:1.0:1776191014.140318:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2867
00000100:00100000:1.0:1776191014.140322:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001abea6d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630841600:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191014.140364:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001abea6d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630841600:12345-0@lo:400:kworker/u8:4.0 Request processed in 40us (693us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191014.140370:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2867
00000100:00100000:1.0:1776191014.140389:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009f8cb77f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630841472:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191014.140421:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191014.140435:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005c8cf6d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630841728:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191014.140455:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191014.140469:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:1.0:1776191014.140475:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029e81afd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630841664:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191014.140499:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191014.140515:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001672005a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630842048:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191014.140536:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191014.140557:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630841728
00000100:00100000:1.0:1776191014.140573:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2868
00000100:00100000:1.0:1776191014.140577:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000934a8884 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630841728:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191014.140609:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000934a8884 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630841728:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (154us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191014.140615:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2868
00000100:00100000:1.0:1776191014.140632:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630841664
00000100:00100000:1.0:1776191014.140648:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630842048
00000100:00100000:1.0:1776191014.140664:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4202
00000100:00100000:1.0:1776191014.140667:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd82c1e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630841664:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191014.140695:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd82c1e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630841664:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (196us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191014.140701:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4202
00000100:00100000:1.0:1776191014.140710:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4203
00000100:00100000:1.0:1776191014.140714:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096baf6e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630842048:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191014.140737:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096baf6e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630842048:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (201us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191014.140743:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4203
00000100:00100000:1.0:1776191014.140770:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029e81afd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630841664:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191014.140779:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001672005a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630842048:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191014.140786:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005c8cf6d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630841728:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191014.140809:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eea60842 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630841600:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191014.142396:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776191014.142410:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002ae10efb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630842112:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191014.142460:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191014.142905:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630842112
00000100:00100000:0.0:1776191014.142948:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448
00000100:00100000:0.0:1776191014.143029:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ff69c039 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630842112:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191014.143078:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191014.143174:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ff69c039 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630842112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (715us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191014.143197:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448
00000100:00100000:2.0:1776191014.147130:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002ae10efb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630842112:0@lo:13:osp-pre-0-0.0
00010000:00010000:0.0:1776191014.906705:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191015.773737:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191015.773784:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191015.773823:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191015.773929:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613773696
00000100:00100000:0.0:1776191015.773986:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613773760
00000100:00100000:0.0:1776191015.774008:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4204
00000100:00100000:0.0:1776191015.774014:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cfd19ce2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613773696:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191015.774131:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cfd19ce2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613773696:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 116us (346us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191015.774138:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4204
00000100:00100000:0.0:1776191015.774170:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4205
00000100:00100000:0.0:1776191015.774174:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c122e652 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613773760:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191015.774198:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c122e652 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613773760:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 24us (376us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191015.774203:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4205
00000100:00100000:2.0:1776191015.783799:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191015.783844:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191015.784189:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613773824
00000100:00100000:1.0:1776191015.784240:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613773888
00000100:00100000:1.0:1776191015.784264:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1856
00000100:00100000:1.0:1776191015.784271:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003bf38be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613773824:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191015.784341:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003bf38be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613773824:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 69us (549us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191015.784347:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1856
00000100:00100000:1.0:1776191015.784364:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2085
00000100:00100000:1.0:1776191015.784367:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000becbf456 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613773888:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:1.0:1776191015.784456:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191015.784482:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000becbf456 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613773888:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 114us (638us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191015.784489:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2085
00010000:00010000:0.0:1776191015.930278:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191016.954362:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191017.210650:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eb0e72b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630842176:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191017.210731:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191017.212236:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630842176
00000100:00100000:2.0:1776191017.212306:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2869
00000100:00100000:2.0:1776191017.212312:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000087950b98 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630842176:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191017.212349:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191017.212420:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000087950b98 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630842176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (1690us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191017.212427:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2869
00000100:00100000:0.0:1776191017.212552:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eb0e72b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630842176:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191017.978319:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191018.234520:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191018.234534:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051374a14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630842240:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191018.234592:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191018.234856:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051374a14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630842240:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191019.002358:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1776191019.258273:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191019.258280:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191019.258283:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191019.258290:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3552
00000100:00080000:0.0:1776191019.258294:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191019.258299:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191019.258320:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000056503154 x1862467630842752/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191019.258335:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191019.258338:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191019.258340:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191019.258343:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3552
00000100:00080000:0.0:1776191019.258344:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191019.258347:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191019.258357:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000ff726a53 x1862467630842816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191019.258401:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de454674 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630842496:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191019.258463:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191019.258488:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000023fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630842880:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191019.258508:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191019.258527:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:0.0:1776191019.258531:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009f44bd72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630842432:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191019.258553:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191019.258565:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f50805c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630842688:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191019.258584:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191019.258621:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000056503154 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630842752:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191019.258657:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191019.258669:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ff726a53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630842816:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191019.258688:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191019.258723:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630842688
00000100:00100000:0.0:1776191019.258759:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630842752
00000100:00100000:0.0:1776191019.258770:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630842816
00000100:00100000:0.0:1776191019.258781:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1857
00000100:00100000:0.0:1776191019.258787:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000b9cbeaa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630842688:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191019.258830:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000b9cbeaa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630842688:12345-0@lo:400:kworker/u8:4.0 Request processed in 43us (245us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191019.258837:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1857
00000100:00100000:0.0:1776191019.258855:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2086
00000100:00100000:0.0:1776191019.258858:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093500675 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630842752:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191019.258965:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191019.258997:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093500675 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630842752:12345-0@lo:8:kworker/u8:4.0 Request processed in 138us (340us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191019.259003:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2086
00000100:00100000:0.0:1776191019.259012:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2087
00000100:00100000:0.0:1776191019.259015:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d475367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630842816:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191019.259132:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191019.259154:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d475367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630842816:12345-0@lo:8:kworker/u8:4.0 Request processed in 138us (466us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191019.259160:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2087
00000100:00080000:0.0:1776191019.259193:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191019.259196:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191019.259201:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000056503154 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630842752:0@lo:8:kworker/u8:4.0
00000100:00080000:0.0:1776191019.259210:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191019.259212:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191019.259214:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ff726a53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630842816:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191019.259242:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f50805c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630842688:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191019.259501:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630842496
00000100:00100000:1.0:1776191019.259528:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630842880
00000100:00100000:1.0:1776191019.259546:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4206
00000100:00100000:1.0:1776191019.259550:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000241a0ec2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630842496:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191019.259590:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000241a0ec2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630842496:12345-0@lo:400:kworker/u8:4.0 Request processed in 39us (1127us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191019.259596:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4206
00000100:00100000:1.0:1776191019.259607:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4207
00000100:00100000:1.0:1776191019.259609:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000a8a89e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630842880:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191019.259630:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000a8a89e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630842880:12345-0@lo:400:kworker/u8:4.0 Request processed in 20us (1122us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191019.259635:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4207
00000100:00100000:1.0:1776191019.259672:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de454674 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630842496:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191019.259683:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000023fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630842880:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191019.259788:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000039985528 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630842304:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191019.259821:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191019.259838:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008ba1222e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630842560:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191019.259860:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191019.259886:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d55fd4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630842944:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191019.259907:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191019.259923:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:2.0:1776191019.259928:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f2ed044 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630842368:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191019.259945:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191019.259957:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bf7cf36f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630842624:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191019.259989:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191019.260011:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630842624
00000100:00100000:0.0:1776191019.260072:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630842432
00000100:00100000:0.0:1776191019.260100:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630842560
00000100:00100000:0.0:1776191019.260112:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2871
00000100:00100000:0.0:1776191019.260115:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b397ad6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630842432:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191019.260146:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b397ad6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630842432:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (1593us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191019.260151:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2871
00000100:00100000:0.0:1776191019.260161:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2872
00000100:00100000:0.0:1776191019.260164:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000fc4ac59 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630842560:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191019.260187:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000fc4ac59 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630842560:12345-0@lo:400:kworker/u8:4.0 Request processed in 22us (326us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191019.260192:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2872
00000100:00100000:0.0:1776191019.260209:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630842944
00000100:00100000:0.0:1776191019.260224:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630842368
00000100:00100000:1.0:1776191019.260298:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000636d25c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630843072:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191019.260322:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191019.263113:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4208
00000100:00100000:0.0:1776191019.263124:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001bf5e7c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630842944:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191019.263213:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001bf5e7c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630842944:12345-0@lo:400:kworker/u8:4.0 Request processed in 90us (3305us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191019.263221:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4208
00000100:00100000:0.0:1776191019.263240:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4209
00000100:00100000:0.0:1776191019.263244:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000089941aa0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630842368:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191019.263271:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000089941aa0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630842368:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (3326us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191019.263277:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4209
00000100:00100000:1.0:1776191019.267543:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009f44bd72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630842432:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191019.267619:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630842304
00000100:00100000:1.0:1776191019.267667:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1600
00000100:00100000:1.0:1776191019.267672:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e23389f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630842304:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191019.267742:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e23389f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630842304:12345-0@lo:400:kworker/u8:4.0 Request processed in 69us (7920us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191019.267749:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1600
00000100:00100000:1.0:1776191019.267833:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f2ed044 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630842368:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191019.267844:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bf7cf36f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630842624:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191019.267852:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000039985528 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630842304:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191019.267862:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008ba1222e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630842560:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191019.267872:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d55fd4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630842944:0@lo:400:kworker/u8:4.0
00010000:00010000:0.0:1776191020.026264:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191020.890971:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191020.891006:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191020.891091:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191020.891132:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191020.891186:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613774144
00000100:00100000:1.0:1776191020.891218:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613774080
00000100:00100000:0.0:1776191020.891249:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1859
00000100:00100000:1.0:1776191020.891249:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4210
00000100:00100000:0.0:1776191020.891256:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ff726a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613774144:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191020.891256:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000023fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613774080:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191020.891327:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ff726a53 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613774144:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 71us (196us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191020.891335:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1859
00000100:00100000:2.0:1776191020.891422:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613773952
00000100:00100000:2.0:1776191020.891452:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1601
00000100:00100000:2.0:1776191020.891456:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4da44d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613773952:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191020.895877:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000023fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613774080:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 4613us (4778us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191020.895892:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4210
00000100:00100000:0.0:1776191020.905371:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191020.905408:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4da44d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613773952:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 13949us (14442us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191020.905422:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1601
00010000:00010000:0.0:1776191021.050914:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191022.074227:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191022.332379:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eb0e72b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630843136:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191022.332447:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191022.332776:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630843136
00000100:00100000:2.0:1776191022.332823:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2873
00000100:00100000:2.0:1776191022.332829:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000d20c9eb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630843136:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191022.332875:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191022.332931:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000d20c9eb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630843136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (484us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191022.332937:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2873
00000100:00100000:0.0:1776191022.333101:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eb0e72b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630843136:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191023.102074:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191023.354340:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191023.354374:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eb0e72b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630843200:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191023.354439:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191023.354766:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eb0e72b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630843200:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191024.122260:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191024.378226:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae81ed6a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630843264:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191024.378303:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191024.378339:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ac42fbca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630843520:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191024.378375:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191024.378396:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b1b67b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630843904:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191024.378426:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191024.378458:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001425031c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630843392:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191024.378487:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191024.378503:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005c6da23c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630843648:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191024.378523:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191024.378537:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [2->3]
00000100:00100000:0.0:1776191024.378544:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000af1b2795 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630843328:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191024.378564:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191024.378583:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006de4f7b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630843584:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191024.378605:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191024.378620:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000424d0623 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630843968:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191024.378642:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191024.378662:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a2a7dce2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630843776:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191024.378680:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191024.378693:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c5625d66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630843840:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191024.378712:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191024.378737:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630843456
00000100:00100000:0.0:1776191024.378754:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630843584
00000100:00100000:0.0:1776191024.378766:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2875
00000100:00100000:0.0:1776191024.378770:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000cbdfd62 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630843456:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191024.378809:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000cbdfd62 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630843456:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (395us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191024.378818:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2875
00000100:00100000:0.0:1776191024.378837:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2876
00000100:00100000:0.0:1776191024.378841:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c049762 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630843584:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191024.378842:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630843264
00000100:00100000:0.0:1776191024.378871:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c049762 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630843584:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (268us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191024.378876:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1602
00000100:00100000:0.0:1776191024.378882:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2876
00000100:00100000:1.0:1776191024.378885:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e54e7edc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630843264:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191024.378905:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630843328
00000100:00100000:0.0:1776191024.378935:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1451
00000100:00100000:1.0:1776191024.378936:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e54e7edc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630843264:12345-0@lo:400:kworker/u8:2.0 Request processed in 49us (632us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191024.378942:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002d7eb8c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630843328:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191024.378948:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1602
00002000:00000024:0.0:1776191024.378976:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191024.378992:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630843520
00000100:00100000:0.0:1776191024.379012:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002d7eb8c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630843328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (448us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191024.379020:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1451
00000100:00100000:1.0:1776191024.379021:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630843904
00000100:00100000:0.0:1776191024.379069:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630843776
00000100:00100000:1.0:1776191024.379071:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630843392
00000100:00100000:0.0:1776191024.379086:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630843840
00000100:00100000:1.0:1776191024.379096:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630843968
00000100:00100000:0.0:1776191024.379099:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1861
00000100:00100000:0.0:1776191024.379104:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ee2fc84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630843648:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191024.379115:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4212
00000100:00100000:1.0:1776191024.379120:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001672005a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630843520:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191024.379137:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ee2fc84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630843648:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (613us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191024.379145:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1861
00000100:00100000:1.0:1776191024.379161:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001672005a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630843520:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (784us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191024.379163:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2089
00000100:00100000:0.0:1776191024.379169:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e63aab7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630843776:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191024.379174:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4212
00000100:00100000:1.0:1776191024.379189:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4213
00000100:00100000:1.0:1776191024.379192:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc2a3d25 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630843904:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191024.379217:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc2a3d25 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630843904:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (793us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191024.379222:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4213
00000100:00100000:1.0:1776191024.379232:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4214
00000100:00100000:1.0:1776191024.379234:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000083bd922b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630843392:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191024.379257:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000083bd922b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630843392:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (772us total) trans 0 rc 0/0
00010000:02020000:0.0:1776191024.379264:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191024.379272:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4214
00000100:00100000:1.0:1776191024.379285:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4215
00000100:00100000:1.0:1776191024.379289:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003ac71d2b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630843968:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191024.379301:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e63aab7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630843776:12345-0@lo:8:kworker/u8:2.0 Request processed in 131us (620us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191024.379308:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2089
00000100:00100000:0.0:1776191024.379323:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2090
00000100:00100000:1.0:1776191024.379327:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003ac71d2b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630843968:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (682us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191024.379329:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d35a805b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630843840:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191024.379339:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4215
00010000:02020000:0.0:1776191024.379412:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191024.379412:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000073716db5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630843456:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191024.379442:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007582ba84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630844032:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191024.379443:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d35a805b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630843840:12345-0@lo:8:kworker/u8:2.0 Request processed in 113us (728us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191024.379455:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2090
00000100:00100000:1.0:1776191024.379474:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1776191024.379484:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191024.379489:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191024.379493:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a2a7dce2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630843776:0@lo:8:kworker/u8:2.0
00000100:00080000:0.0:1776191024.379504:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191024.379507:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191024.379510:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000af1b2795 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630843328:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191024.379511:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c5625d66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630843840:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191024.379531:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006de4f7b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630843584:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191024.379538:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630844032
00000100:00100000:1.0:1776191024.379545:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000424d0623 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630843968:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191024.379559:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1452
00000100:00100000:1.0:1776191024.379560:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001425031c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630843392:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191024.379566:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000911fdeb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3366:x1862467630844032:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191024.379573:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005c6da23c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630843648:0@lo:400:kworker/u8:2.0
00002000:00000024:0.0:1776191024.379577:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191024.379609:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000911fdeb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3366:x1862467630844032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (137us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191024.379615:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1452
00000100:00100000:1.0:1776191024.379620:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007582ba84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630844032:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191024.379646:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b1b67b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630843904:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191024.379658:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ac42fbca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630843520:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191024.379665:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae81ed6a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630843264:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191024.380485:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000074fc7059 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630843712:0@lo:400:kworker/u8:2.0
00010000:00010000:0.0:1776191025.146475:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191026.015312:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191026.015358:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191026.015391:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191026.015424:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191026.015469:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613774464
00000100:00100000:0.0:1776191026.015531:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1862
00000100:00100000:0.0:1776191026.015539:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c8cf6d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613774464:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191026.015643:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613774272
00000100:00100000:1.0:1776191026.015673:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1603
00000100:00100000:1.0:1776191026.015677:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f9ea876 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613774272:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191026.015744:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4217
00000100:00100000:2.0:1776191026.015750:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eea60842 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613774400:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191026.015812:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c8cf6d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613774464:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 273us (388us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191026.015820:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1862
00000100:00100000:1.0:1776191026.018719:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f9ea876 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613774272:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 3037us (3412us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191026.018731:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1603
00000100:00100000:2.0:1776191026.019345:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eea60842 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613774400:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 3592us (3952us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191026.019358:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4217
00000100:00100000:0.0:1776191026.023326:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191026.023439:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613774528
00000100:00100000:1.0:1776191026.023523:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2091
00000100:00100000:1.0:1776191026.023530:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029e81afd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613774528:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:1.0:1776191026.023638:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191026.023752:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029e81afd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613774528:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 222us (434us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191026.023759:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2091
00010000:00010000:0.0:1776191026.170369:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191027.194313:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191027.450512:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006eae40ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630844096:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191027.450586:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191027.450679:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630844096
00000100:00100000:2.0:1776191027.450731:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2877
00000100:00100000:2.0:1776191027.450737:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ae1da2b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630844096:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191027.450771:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191027.450815:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ae1da2b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630844096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (230us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191027.450822:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2877
00000100:00100000:0.0:1776191027.450918:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006eae40ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630844096:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191028.218408:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191028.479400:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630844160
00000100:00100000:0.0:1776191028.479462:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2878
00000100:00100000:0.0:1776191028.479469:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ce2fb2ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630844160:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191028.479503:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191028.479581:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ce2fb2ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630844160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (1607us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191028.479588:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2878
00010000:00010000:0.0:1776191029.244955:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1776191029.498612:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191029.498619:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191029.498622:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191029.498630:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3562
00000100:00080000:1.0:1776191029.498633:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191029.498638:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191029.498658:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000636d25c3 x1862467630844672/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191029.498673:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191029.498676:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191029.498678:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191029.498681:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3562
00000100:00080000:1.0:1776191029.498683:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191029.498686:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191029.498694:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000002ae10efb x1862467630844800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191029.498714:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dcfa8951 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630844416:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191029.498727:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000636d25c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630844672:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191029.498842:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191029.500337:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002ae10efb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630844800:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191029.500389:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191029.500450:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630844672
00000100:00100000:1.0:1776191029.500482:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630844800
00000100:00100000:1.0:1776191029.500501:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2092
00000100:00100000:1.0:1776191029.500506:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000c128c04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630844672:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:1.0:1776191029.500619:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191029.500661:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000c128c04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630844672:12345-0@lo:8:kworker/u8:2.0 Request processed in 154us (1820us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191029.500668:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2092
00000100:00100000:1.0:1776191029.500686:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2093
00000100:00100000:1.0:1776191029.500689:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af1b2795 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630844800:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:1.0:1776191029.500770:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191029.500794:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af1b2795 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630844800:12345-0@lo:8:kworker/u8:2.0 Request processed in 103us (405us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191029.500799:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2093
00000100:00080000:1.0:1776191029.500835:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191029.500838:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191029.500842:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000636d25c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630844672:0@lo:8:kworker/u8:2.0
00000100:00080000:1.0:1776191029.500850:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191029.500853:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191029.501053:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002ae10efb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630844800:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191029.501112:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ca7e4d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630844288:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191029.501143:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191029.501161:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008d1e8454 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630844544:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191029.501181:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191029.501195:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002c9bae2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630844928:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191029.501216:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191029.501247:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000301f1ca1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630844352:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191029.501273:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191029.501288:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000321faac3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630844608:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191029.501306:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191029.501331:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630844544
00000100:00100000:1.0:1776191029.501356:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630844608
00000100:00100000:1.0:1776191029.501370:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1863
00000100:00100000:1.0:1776191029.501374:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000636d25c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630844544:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191029.501415:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000636d25c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630844544:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (233us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191029.501421:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1863
00000100:00100000:1.0:1776191029.501433:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1864
00000100:00100000:1.0:1776191029.501437:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b92c4097 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630844608:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191029.501462:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b92c4097 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630844608:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (155us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191029.501468:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1864
00000100:00100000:1.0:1776191029.501491:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000321faac3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630844608:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191029.501509:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008d1e8454 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630844544:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191029.502025:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191029.502057:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080311080 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630844736:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191029.502084:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191029.502123:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630844288
00000100:00100000:2.0:1776191029.502149:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630844928
00000100:00100000:2.0:1776191029.502180:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630844416
00000100:00100000:2.0:1776191029.502197:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4218
00000100:00100000:2.0:1776191029.502202:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ae10efb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630844288:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191029.502234:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ae10efb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630844288:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (1090us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191029.502240:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4218
00000100:00100000:2.0:1776191029.502251:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4219
00000100:00100000:2.0:1776191029.502256:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048e1f2c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630844928:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191029.502279:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048e1f2c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630844928:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (1063us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191029.502284:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4219
00000100:00100000:1.0:1776191029.502488:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ca7e4d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630844288:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191029.502504:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002c9bae2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630844928:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191029.502614:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4220
00000100:00100000:0.0:1776191029.502620:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e751c43d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630844416:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191029.502720:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005c5a025e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630844992:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191029.503540:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e751c43d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630844416:12345-0@lo:400:kworker/u8:2.0 Request processed in 918us (1514us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191029.503553:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4220
00000100:00100000:0.0:1776191029.503586:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630844736
00000100:00100000:0.0:1776191029.503618:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453
00000100:00100000:2.0:1776191029.503620:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630844352
00000100:00100000:0.0:1776191029.503624:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000567d6097 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630844736:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191029.503651:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191029.503655:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2879
00000100:00100000:2.0:1776191029.503660:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001d7d2914 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630844352:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191029.503694:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000567d6097 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630844736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (1608us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191029.503702:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453
00000100:00100000:2.0:1776191029.503706:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001d7d2914 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630844352:12345-0@lo:400:kworker/u8:2.0 Request processed in 44us (2431us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191029.503715:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2879
00000100:00100000:2.0:1776191029.503761:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dcfa8951 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630844416:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191029.503767:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630844224
00000100:00100000:2.0:1776191029.503782:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080311080 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630844736:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191029.503797:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1604
00000100:00100000:0.0:1776191029.503802:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000653a1d11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630844224:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191029.503835:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000653a1d11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630844224:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (1337us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191029.503841:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1604
00000100:00100000:1.0:1776191029.507808:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191029.507918:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630844480
00000100:00100000:2.0:1776191029.507971:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2880
00000100:00100000:2.0:1776191029.507977:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000074fc7059 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630844480:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191029.508279:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000301f1ca1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630844352:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191029.508742:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630844992
00000100:00100000:0.0:1776191029.508782:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454
00000100:00100000:0.0:1776191029.508786:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d20676ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630844992:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191029.508803:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191029.508853:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d20676ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630844992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (1053us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191029.509013:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454
00000100:00100000:2.0:1776191029.509680:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000074fc7059 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630844480:12345-0@lo:400:kworker/u8:2.0 Request processed in 1699us (1864us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191029.509689:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2880
00010000:00010000:0.0:1776191030.266339:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191031.131376:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613774656
00000100:00100000:1.0:1776191031.131376:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613774592
00000100:00100000:1.0:1776191031.131428:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1605
00000100:00100000:1.0:1776191031.131434:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd6c2b01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613774592:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191031.131503:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd6c2b01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613774592:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 69us (304us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191031.131510:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1605
00000100:00100000:0.0:1776191031.131685:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4222
00000100:00100000:0.0:1776191031.131701:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ac42fbca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613774656:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191031.131755:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ac42fbca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613774656:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 62us (487us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191031.131763:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4222
00000100:00100000:1.0:1776191031.135852:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613774784
00000100:00100000:1.0:1776191031.135913:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1865
00000100:00100000:1.0:1776191031.135919:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c6da23c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613774784:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191031.136008:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c6da23c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613774784:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 88us (315us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191031.136015:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1865
00000100:00100000:0.0:1776191031.136737:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613774720
00000100:00100000:0.0:1776191031.136780:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4223
00000100:00100000:0.0:1776191031.136785:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b1b67b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613774720:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191031.136851:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b1b67b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613774720:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 64us (1582us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191031.136857:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4223
00000100:00100000:2.0:1776191031.138361:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613774848
00000100:00100000:2.0:1776191031.138408:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2094
00000100:00100000:2.0:1776191031.138415:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001425031c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613774848:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:2.0:1776191031.138515:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191031.138582:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001425031c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613774848:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 166us (395us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191031.138590:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2094
00010000:00010000:0.0:1776191031.290292:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191032.314817:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191032.575393:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630845056
00000100:00100000:2.0:1776191032.575451:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2881
00000100:00100000:2.0:1776191032.575457:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000424d0623 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630845056:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191032.575502:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191032.575563:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000424d0623 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630845056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (834us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191032.575570:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2881
00000100:00100000:1.0:1776191032.575740:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080311080 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630845056:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191033.338235:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191033.596549:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003bf38be7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630845120:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191033.596614:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191033.597669:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003bf38be7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630845120:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191034.362375:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191034.618253:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000becbf456 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630845184:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191034.618327:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191034.619264:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630845184
00000100:00100000:1.0:1776191034.619365:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004831c73f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630845248:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191034.619373:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1455
00000100:00100000:2.0:1776191034.619381:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0fd09fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630845184:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191034.619411:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191034.619418:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1776191034.619452:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191034.619457:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191034.619461:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191034.619467:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3567
00000100:00100000:2.0:1776191034.619469:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0fd09fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630845184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (1140us total) trans 0 rc 0/0
00000100:00080000:0.0:1776191034.619471:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191034.619478:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191034.619482:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1455
00000100:00100000:0.0:1776191034.619499:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000dab16da3 x1862467630845696/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191034.619515:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191034.619519:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191034.619520:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191034.619523:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3567
00000100:00080000:0.0:1776191034.619525:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191034.619539:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191034.619551:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000589db251 x1862467630845760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191034.619584:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005c5a025e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630845312:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191034.619618:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191034.619635:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000af172616 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630845568:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191034.619656:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191034.619672:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:0.0:1776191034.619677:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e63aab7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630845504:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191034.619700:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191034.619714:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630845888:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191034.619733:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191034.619779:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630845312
00000100:00100000:0.0:1776191034.619805:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1606
00000100:00100000:0.0:1776191034.619810:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000040bbf344 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630845312:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191034.619842:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000040bbf344 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630845312:12345-0@lo:400:kworker/u8:4.0 Request processed in 32us (224us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191034.619849:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1606
00000100:00100000:0.0:1776191034.619876:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630845504
00000100:00100000:0.0:1776191034.619911:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630845888
00000100:00100000:0.0:1776191034.619927:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4224
00000100:00100000:0.0:1776191034.619932:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096ba125a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630845504:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191034.619961:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096ba125a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630845504:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (261us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191034.619966:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4224
00000100:00100000:0.0:1776191034.619977:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4225
00000100:00100000:0.0:1776191034.619980:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004e5b784 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630845888:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191034.620001:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004e5b784 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630845888:12345-0@lo:400:kworker/u8:4.0 Request processed in 21us (267us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191034.620006:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4225
00000100:00100000:0.0:1776191034.620027:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076ea9d35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630845376:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191034.620075:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191034.620089:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005c0278cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630845632:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191034.620110:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191034.620127:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:0.0:1776191034.620131:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ee2fc84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630845440:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191034.620150:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191034.620163:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000002f18e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630845824:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191034.620181:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191034.620198:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630845376
00000100:00100000:0.0:1776191034.620219:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630845824
00000100:00100000:0.0:1776191034.620235:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4226
00000100:00100000:0.0:1776191034.620239:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a868d0c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630845376:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191034.620268:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a868d0c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630845376:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (193us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191034.620274:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4226
00000100:00100000:0.0:1776191034.620285:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4227
00000100:00100000:0.0:1776191034.620289:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a81e70bb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630845824:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191034.620312:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a81e70bb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630845824:12345-0@lo:400:kworker/u8:4.0 Request processed in 22us (130us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191034.620317:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4227
00000100:00100000:0.0:1776191034.620363:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000becbf456 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630845184:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191034.620391:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000002f18e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630845824:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191034.620400:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076ea9d35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630845376:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191034.620425:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e63aab7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630845504:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191034.620433:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630845888:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191034.620439:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005c5a025e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630845312:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191034.620475:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dab16da3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630845696:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191034.620498:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191034.620512:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000589db251 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630845760:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191034.620530:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191034.620560:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630845632
00000100:00100000:0.0:1776191034.620583:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630845696
00000100:00100000:0.0:1776191034.620595:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630845760
00000100:00100000:0.0:1776191034.620608:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1866
00000100:00100000:0.0:1776191034.620611:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000118d0482 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630845632:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191034.620645:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000118d0482 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630845632:12345-0@lo:400:kworker/u8:4.0 Request processed in 32us (534us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191034.620650:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1866
00000100:00100000:0.0:1776191034.620661:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2095
00000100:00100000:0.0:1776191034.620664:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d5dde41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630845696:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191034.620762:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191034.620791:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d5dde41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630845696:12345-0@lo:8:kworker/u8:4.0 Request processed in 126us (294us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191034.620796:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2095
00000100:00100000:0.0:1776191034.620807:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2096
00000100:00100000:0.0:1776191034.620809:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f43f1e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630845760:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191034.620888:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191034.620910:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f43f1e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630845760:12345-0@lo:8:kworker/u8:4.0 Request processed in 99us (379us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191034.620915:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2096
00000100:00080000:0.0:1776191034.620937:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191034.620940:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191034.620943:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dab16da3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630845696:0@lo:8:kworker/u8:4.0
00000100:00080000:0.0:1776191034.620949:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191034.620951:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191034.620953:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000589db251 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630845760:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191034.620977:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005c0278cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630845632:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191034.621027:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630845568
00000100:00100000:0.0:1776191034.621075:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630845440
00000100:00100000:0.0:1776191034.621086:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2883
00000100:00100000:0.0:1776191034.621089:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f3626cf8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630845568:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191034.621122:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f3626cf8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630845568:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (1465us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191034.621128:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2883
00000100:00100000:0.0:1776191034.621138:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2884
00000100:00100000:0.0:1776191034.621142:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090a9e988 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630845440:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191034.621169:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090a9e988 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630845440:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (1018us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191034.621175:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2884
00000100:00100000:0.0:1776191034.621206:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ee2fc84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630845440:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191034.621228:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000af172616 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630845568:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191034.622563:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630845248
00000100:00100000:2.0:1776191034.622609:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1456
00000100:00100000:2.0:1776191034.622614:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a96a54e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630845248:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191034.622635:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191034.622678:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a96a54e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630845248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (3265us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191034.622685:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1456
00000100:00100000:1.0:1776191034.622880:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004831c73f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630845248:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1776191035.387745:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191036.253550:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613774912
00000100:00100000:0.0:1776191036.253612:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1607
00000100:00100000:0.0:1776191036.253621:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bbf84eea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613774912:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191036.253693:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bbf84eea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613774912:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 73us (239us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191036.253702:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1607
00000100:00100000:2.0:1776191036.253825:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613775040
00000100:00100000:2.0:1776191036.253865:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613774976
00000100:00100000:2.0:1776191036.253895:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4228
00000100:00100000:2.0:1776191036.253900:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006de4f7b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613775040:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191036.253935:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006de4f7b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613775040:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 34us (428us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191036.253941:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4228
00000100:00100000:2.0:1776191036.253956:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4229
00000100:00100000:2.0:1776191036.253960:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c5625d66 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613774976:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191036.253995:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c5625d66 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613774976:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 34us (451us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191036.254002:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4229
00000100:00100000:0.0:1776191036.255147:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613775168
00000100:00100000:0.0:1776191036.255181:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2097
00000100:00100000:0.0:1776191036.255185:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000073716db5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613775168:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:0.0:1776191036.255282:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191036.255325:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000073716db5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613775168:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 139us (378us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191036.255331:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2097
00010000:00010000:0.0:1776191036.410277:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191037.437378:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191037.690716:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051374a14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630845952:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191037.690787:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191037.690854:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630845952
00000100:00100000:1.0:1776191037.690914:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2885
00000100:00100000:1.0:1776191037.690921:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af172616 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630845952:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191037.690961:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191037.696147:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af172616 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630845952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5218us (5353us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191037.696164:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2885
00000100:00100000:0.0:1776191037.697635:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051374a14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630845952:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191038.460111:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191038.714682:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191038.714706:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eb0e72b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630846016:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191038.714835:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191038.715315:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eb0e72b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630846016:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191039.482783:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191039.738508:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004831c73f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630846080:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191039.738586:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191039.740845:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776191039.740859:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7fc0454 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630846208:0@lo:400:kworker/u8:4.0
00000100:00080000:1.0:1776191039.740877:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191039.740883:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191039.740886:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191039.740892:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3572
00000100:00080000:1.0:1776191039.740894:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191039.740900:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191039.740920:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000301f1ca1 x1862467630846592/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191039.740928:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191039.740944:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191039.740948:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191039.740950:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1776191039.740950:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a2eb5de3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630846400:0@lo:400:kworker/u8:4.0
00000100:00080000:1.0:1776191039.740955:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3572
00000100:00080000:1.0:1776191039.740958:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191039.740961:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191039.740974:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000dcfa8951 x1862467630846656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191039.740983:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191039.741006:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ca7e4d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630846784:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191039.741019:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000070c80d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630846464:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191039.741029:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191039.741078:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191039.741085:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630846400
00000100:00100000:1.0:1776191039.741120:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000301f1ca1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630846592:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191039.741145:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191039.741157:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dcfa8951 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630846656:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191039.741176:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191039.741209:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630846592
00000100:00100000:1.0:1776191039.741236:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630846656
00000100:00100000:1.0:1776191039.741251:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2098
00000100:00100000:1.0:1776191039.741256:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000321faac3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630846592:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191039.741302:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630846784
00000100:00100000:2.0:1776191039.741325:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4230
00000100:00100000:2.0:1776191039.741329:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000becbf456 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630846400:12345-0@lo:400:kworker/u8:4.0
00010000:02020000:1.0:1776191039.741352:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191039.741379:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000becbf456 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630846400:12345-0@lo:400:kworker/u8:4.0 Request processed in 48us (397us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191039.741386:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4230
00000100:00100000:2.0:1776191039.741403:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4231
00000100:00100000:2.0:1776191039.741407:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003bf38be7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630846784:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191039.741434:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003bf38be7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630846784:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (407us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191039.741439:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4231
00000100:00100000:2.0:1776191039.741464:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630846080
00000100:00100000:0.0:1776191039.741646:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2099
00000100:00100000:0.0:1776191039.741651:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd716f95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630846656:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191039.741737:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191039.742813:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd716f95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630846656:12345-0@lo:8:kworker/u8:4.0 Request processed in 1160us (1635us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191039.742822:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2099
00000100:00100000:0.0:1776191039.742839:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630846528
00000100:00100000:0.0:1776191039.742866:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1868
00000100:00100000:0.0:1776191039.742870:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000b9cbeaa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630846528:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191039.743060:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000b9cbeaa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630846528:12345-0@lo:400:kworker/u8:4.0 Request processed in 189us (781us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191039.743066:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1868
00000100:00100000:0.0:1776191039.743126:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007582ba84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630846528:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191039.743301:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1457
00000100:00100000:2.0:1776191039.743306:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000051374a14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630846080:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191039.743328:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191039.743359:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000051374a14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630846080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (4774us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191039.743365:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1457
00000100:00100000:2.0:1776191039.743387:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191039.743417:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630846720
00000100:00100000:2.0:1776191039.743439:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630846272
00000100:00100000:2.0:1776191039.743458:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4232
00000100:00100000:2.0:1776191039.743461:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000075f8236 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630846720:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191039.743490:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000075f8236 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630846720:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (1393us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191039.743496:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4232
00000100:00100000:2.0:1776191039.743506:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4233
00000100:00100000:2.0:1776191039.743509:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008bacde2f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630846272:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191039.743530:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008bacde2f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630846272:12345-0@lo:400:kworker/u8:4.0 Request processed in 20us (1287us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191039.743535:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4233
00000100:00100000:2.0:1776191039.743551:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630846144
00000100:00100000:2.0:1776191039.743570:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1458
00000100:00100000:2.0:1776191039.743574:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000080311080 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630846144:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191039.743583:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191039.743608:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000080311080 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630846144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (222us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191039.743790:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1458
00000100:00100000:2.0:1776191039.743823:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eb0e72b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630846144:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191039.743854:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ca7e4d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630846784:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191039.743864:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a2eb5de3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630846400:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191039.743877:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004831c73f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630846080:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191039.744001:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630846208
00000100:00100000:2.0:1776191039.744024:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1608
00000100:00100000:2.0:1776191039.744028:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000351c4067 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630846208:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191039.744084:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000351c4067 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630846208:12345-0@lo:400:kworker/u8:4.0 Request processed in 54us (3159us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191039.744090:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1608
00000100:00100000:2.0:1776191039.745699:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7fc0454 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630846208:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191039.745799:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2888
00000100:00100000:2.0:1776191039.745806:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000994ca5e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630846336:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191039.745868:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000994ca5e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630846336:12345-0@lo:400:kworker/u8:4.0 Request processed in 61us (3809us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191039.745876:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2888
00000100:00100000:0.0:1776191039.746940:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ecd900ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630846272:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191039.746955:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d55fd4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630846336:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191039.746969:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002c9bae2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630846720:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191039.747426:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000321faac3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630846592:12345-0@lo:8:kworker/u8:4.0 Request processed in 6167us (6279us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191039.747435:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2098
00000100:00080000:2.0:1776191039.747507:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191039.747511:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191039.747515:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000301f1ca1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630846592:0@lo:8:kworker/u8:4.0
00000100:00080000:2.0:1776191039.747525:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191039.747529:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191039.747531:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dcfa8951 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630846656:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191039.747711:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000070c80d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630846464:0@lo:400:kworker/u8:4.0
00010000:00010000:0.0:1776191040.506251:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191041.371663:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613775488
00000100:00100000:1.0:1776191041.371712:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2100
00000100:00100000:1.0:1776191041.371719:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093500675 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613775488:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:1.0:1776191041.371815:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191041.371883:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093500675 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613775488:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 163us (386us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191041.371892:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2100
00000100:00100000:0.0:1776191041.372015:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613775232
00000100:00100000:0.0:1776191041.372135:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1609
00000100:00100000:0.0:1776191041.372140:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048ed839b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613775232:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191041.372174:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048ed839b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613775232:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 33us (732us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191041.372180:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1609
00000100:00100000:1.0:1776191041.372447:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613775360
00000100:00100000:1.0:1776191041.372485:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4234
00000100:00100000:1.0:1776191041.372490:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d475367 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613775360:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191041.372525:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d475367 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613775360:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 34us (148us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191041.372531:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4234
00000100:00100000:1.0:1776191041.376003:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613775424
00000100:00100000:1.0:1776191041.376084:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1869
00000100:00100000:1.0:1776191041.376091:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000079eea346 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613775424:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191041.376163:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000079eea346 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613775424:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 69us (430us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191041.376171:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1869
00000100:00100000:0.0:1776191041.376238:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613775296
00000100:00100000:0.0:1776191041.376381:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4235
00000100:00100000:0.0:1776191041.376386:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ff726a53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613775296:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191041.376418:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ff726a53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613775296:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 31us (736us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191041.376424:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4235
00010000:00010000:0.0:1776191041.530312:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191042.554240:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191042.810444:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eb0e72b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630846848:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191042.810519:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191042.810615:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630846848
00000100:00100000:0.0:1776191042.810666:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2889
00000100:00100000:0.0:1776191042.810672:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8b8f221 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630846848:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191042.810707:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191042.810761:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8b8f221 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630846848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (244us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191042.810769:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2889
00000100:00100000:1.0:1776191042.810877:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eb0e72b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630846848:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191043.580301:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191043.834814:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630846912
00000100:00100000:2.0:1776191043.834870:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2890
00000100:00100000:2.0:1776191043.834876:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000056503154 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630846912:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191043.834911:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191043.834968:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000056503154 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630846912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (254us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191043.834975:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2890
00000100:00100000:1.0:1776191043.835124:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc0a67c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630846912:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191044.602435:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1776191044.861874:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191044.861891:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191044.861896:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191044.861904:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3577
00000100:00080000:1.0:1776191044.861908:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191044.861913:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191044.861934:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000007a1a9e6f x1862467630847424/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191044.861949:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191044.861952:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191044.861953:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191044.861955:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3577
00000100:00080000:1.0:1776191044.861957:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191044.861960:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191044.861970:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000aa646f87 x1862467630847488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191044.862008:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000039985528 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630847104:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191044.862090:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191044.862116:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de454674 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630847360:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191044.862138:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191044.862158:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:1.0:1776191044.862162:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008ba1222e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630847040:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191044.862180:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191044.862191:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009f44bd72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630847296:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191044.862204:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191044.862231:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630847360
00000100:00100000:1.0:1776191044.862265:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630847296
00000100:00100000:1.0:1776191044.862281:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870
00000100:00100000:1.0:1776191044.862286:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000053bdf8f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630847360:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191044.862331:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000053bdf8f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630847360:12345-0@lo:400:kworker/u8:2.0 Request processed in 45us (193us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191044.862339:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870
00000100:00100000:1.0:1776191044.862355:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871
00000100:00100000:1.0:1776191044.862359:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc7ab3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630847296:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191044.862384:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc7ab3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630847296:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (179us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191044.862390:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871
00000100:00100000:1.0:1776191044.862425:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009f44bd72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630847296:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191044.862435:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de454674 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630847360:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191044.862519:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630847040
00000100:00100000:0.0:1776191044.862560:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4236
00000100:00100000:0.0:1776191044.862564:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb7e6216 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630847040:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191044.862599:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb7e6216 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630847040:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (418us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191044.862604:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4236
00000100:00100000:0.0:1776191044.862628:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bf7cf36f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630847168:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191044.862649:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191044.862661:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011d3c5e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630847552:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191044.862679:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191044.862694:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [3->2]
00000100:00100000:0.0:1776191044.862698:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc2bbe9c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630846976:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191044.862720:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191044.862732:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f2ed044 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630847232:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191044.862750:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191044.862760:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a27cd066 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630847616:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191044.862777:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191044.862798:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630846976
00000100:00100000:0.0:1776191044.862819:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1610
00000100:00100000:0.0:1776191044.862822:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000062c92fc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630846976:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191044.862851:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000062c92fc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630846976:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (130us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191044.862856:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1610
00000100:00100000:0.0:1776191044.862878:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630847168
00000100:00100000:0.0:1776191044.862893:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630847552
00000100:00100000:0.0:1776191044.862905:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630847616
00000100:00100000:0.0:1776191044.862915:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4237
00000100:00100000:0.0:1776191044.862918:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000589db251 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630847168:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191044.862942:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000589db251 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630847168:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (293us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191044.862948:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4237
00000100:00100000:0.0:1776191044.862958:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4238
00000100:00100000:0.0:1776191044.862960:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dab16da3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630847552:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191044.862983:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dab16da3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630847552:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (303us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191044.862988:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4238
00000100:00100000:0.0:1776191044.862998:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4239
00000100:00100000:0.0:1776191044.863001:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dcfa8951 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630847616:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191044.863024:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dcfa8951 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630847616:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (247us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191044.863029:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4239
00000100:00100000:0.0:1776191044.863075:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc2bbe9c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630846976:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191044.863085:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a27cd066 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630847616:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191044.863092:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bf7cf36f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630847168:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191044.863098:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011d3c5e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630847552:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191044.863122:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008ba1222e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630847040:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191044.863514:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007a1a9e6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630847424:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191044.863557:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191044.863574:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa646f87 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630847488:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191044.863595:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191044.863662:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eb0e72b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630847680:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191044.863689:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191044.863715:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630847680
00000100:00100000:2.0:1776191044.863738:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1459
00000100:00100000:2.0:1776191044.863742:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d55fd4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630847680:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191044.863762:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191044.863790:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d55fd4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630847680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (102us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191044.863796:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1459
00000100:00100000:2.0:1776191044.863817:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630847424
00000100:00100000:2.0:1776191044.863832:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2101
00000100:00100000:2.0:1776191044.863835:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006eae40ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630847424:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191044.863926:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191044.863958:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006eae40ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630847424:12345-0@lo:8:kworker/u8:2.0 Request processed in 121us (401us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191044.863963:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2101
00000100:00100000:2.0:1776191044.863974:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630847488
00000100:00100000:2.0:1776191044.863987:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2102
00000100:00100000:2.0:1776191044.863990:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc0a67c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630847488:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191044.864091:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191044.864116:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc0a67c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630847488:12345-0@lo:8:kworker/u8:2.0 Request processed in 125us (521us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191044.864121:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2102
00000100:00100000:2.0:1776191044.864153:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eb0e72b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630847680:0@lo:13:osp-pre-0-0.0
00000100:00080000:2.0:1776191044.864178:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191044.864181:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191044.864184:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007a1a9e6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630847424:0@lo:8:kworker/u8:2.0
00000100:00080000:2.0:1776191044.864190:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191044.864192:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191044.864194:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa646f87 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630847488:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191044.864460:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000615cbccf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630847744:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191044.864487:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191044.864519:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000039985528 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630847104:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191044.865624:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630847744
00000100:00100000:1.0:1776191044.865677:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1460
00000100:00100000:1.0:1776191044.865682:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000301f1ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630847744:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191044.865701:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191044.865757:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000301f1ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630847744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (1270us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191044.865764:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1460
00000100:00100000:0.0:1776191044.865911:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000615cbccf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630847744:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1776191045.626547:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191046.490839:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613775744
00000100:00100000:1.0:1776191046.490909:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1872
00000100:00100000:1.0:1776191046.490917:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002116724a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613775744:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191046.491249:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002116724a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613775744:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 332us (486us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191046.494857:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1872
00000100:00100000:1.0:1776191046.494926:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613775552
00000100:00100000:1.0:1776191046.494976:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1611
00000100:00100000:1.0:1776191046.494983:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c45da90d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613775552:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191046.495071:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c45da90d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613775552:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 87us (4274us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191046.495078:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1611
00000100:00100000:0.0:1776191046.499763:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613775616
00000100:00100000:0.0:1776191046.499849:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613775680
00000100:00100000:0.0:1776191046.499879:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4240
00000100:00100000:0.0:1776191046.499886:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000034758e9b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613775616:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191046.499971:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000034758e9b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613775616:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 84us (9327us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191046.499978:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4240
00000100:00100000:0.0:1776191046.499999:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4241
00000100:00100000:0.0:1776191046.500003:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eac92920 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613775680:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191046.500027:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eac92920 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613775680:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 24us (9199us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191046.501741:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4241
00000100:00100000:1.0:1776191046.502766:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613775808
00000100:00100000:1.0:1776191046.502866:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2103
00000100:00100000:1.0:1776191046.502872:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef14d805 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613775808:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:1.0:1776191046.502989:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191046.503095:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef14d805 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613775808:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 222us (6271us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191046.503103:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2103
00010000:00010000:0.0:1776191046.650550:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191047.674399:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191047.936680:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ecd900ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630847808:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191047.936755:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191047.936868:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630847808
00000100:00100000:2.0:1776191047.936954:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2893
00000100:00100000:2.0:1776191047.936960:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002c9bae2d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630847808:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191047.936995:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191047.937078:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002c9bae2d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630847808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (324us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191047.937087:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2893
00010000:00010000:0.0:1776191048.698886:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191048.954483:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630847872
00000100:00100000:2.0:1776191048.954527:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2894
00000100:00100000:2.0:1776191048.954533:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d9b79312 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630847872:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191048.954563:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191048.954609:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d9b79312 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630847872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (219us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191048.954615:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2894
00010000:00010000:0.0:1776191049.723278:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1776191049.979158:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191049.979165:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191049.979168:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191049.979176:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3582
00000100:00080000:0.0:1776191049.979179:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191049.979185:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191049.979204:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000075933c7b x1862467630848384/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191049.979217:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191049.979220:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191049.979221:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191049.979223:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3582
00000100:00080000:0.0:1776191049.979225:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191049.979228:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191049.979236:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000dbd40b9d x1862467630848448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191049.979494:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a2eb5de3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630847936:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191049.979532:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191049.979551:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008b75dd33 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630848192:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191049.979579:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191049.979594:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001d2d29b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630848576:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191049.979613:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191049.979642:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000075933c7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630848384:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191049.979667:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191049.979691:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dbd40b9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630848448:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191049.979725:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191049.979803:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630848192
00000100:00100000:2.0:1776191049.979842:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2895
00000100:00100000:2.0:1776191049.979848:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004831c73f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630848192:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191049.980355:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004831c73f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630848192:12345-0@lo:400:kworker/u8:4.0 Request processed in 504us (773us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191049.980362:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2895
00000100:00100000:1.0:1776191049.980363:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630847936
00000100:00100000:2.0:1776191049.980396:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4243
00000100:00100000:1.0:1776191049.980399:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1612
00000100:00100000:2.0:1776191049.980404:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e7fc0454 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630848576:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191049.980409:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002aaf4bb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630847936:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191049.980447:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e7fc0454 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630848576:12345-0@lo:400:kworker/u8:4.0 Request processed in 44us (833us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191049.980453:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4243
00000100:00100000:2.0:1776191049.980466:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4244
00000100:00100000:2.0:1776191049.980469:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ce45b6e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630848128:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191049.980493:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ce45b6e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630848128:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (733us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191049.980498:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4244
00000100:00100000:2.0:1776191049.980508:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4245
00000100:00100000:2.0:1776191049.980511:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f00cec27 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630848512:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191049.980532:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f00cec27 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630848512:12345-0@lo:400:kworker/u8:4.0 Request processed in 20us (665us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191049.980537:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4245
00000100:00100000:2.0:1776191049.980555:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630848384
00000100:00100000:2.0:1776191049.980573:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630848448
00000100:00100000:2.0:1776191049.980594:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630848320
00000100:00100000:1.0:1776191049.980598:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002aaf4bb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630847936:12345-0@lo:400:kworker/u8:4.0 Request processed in 192us (1066us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191049.980606:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1612
00000100:00100000:2.0:1776191049.980622:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1873
00000100:00100000:2.0:1776191049.980626:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000067aab686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630848320:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191049.980652:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000036033aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630848704:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191049.980658:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000067aab686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630848320:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (727us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191049.980664:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1873
00000100:00100000:2.0:1776191049.980677:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2104
00000100:00100000:2.0:1776191049.980681:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ecd900ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630848384:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191049.980687:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191049.980725:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630848704
00000100:00100000:1.0:1776191049.980747:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461
00000100:00100000:1.0:1776191049.980752:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9d5bfab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630848704:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191049.980773:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00010000:02020000:2.0:1776191049.980774:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191049.980816:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9d5bfab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630848704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (129us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191049.980822:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ecd900ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630848384:12345-0@lo:8:kworker/u8:4.0 Request processed in 139us (1153us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191049.980826:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461
00000100:00100000:2.0:1776191049.980835:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2104
00000100:00100000:2.0:1776191049.980851:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2105
00000100:00100000:2.0:1776191049.980855:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eb0e72b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630848448:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191049.980874:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000036033aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630848704:0@lo:13:osp-pre-0-1.0
00010000:02020000:2.0:1776191049.980935:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1776191049.980943:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191049.980948:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191049.980953:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000075933c7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630848384:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191049.980965:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eb0e72b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630848448:12345-0@lo:8:kworker/u8:4.0 Request processed in 108us (1240us total) trans 0 rc -19/-19
00000100:00080000:1.0:1776191049.980968:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191049.980972:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191049.980973:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2105
00000100:00100000:1.0:1776191049.980978:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dbd40b9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630848448:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191049.981010:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a2eb5de3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630847936:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191049.984086:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191049.984162:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd36ba63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630848640:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191049.984219:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191049.984266:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630848640
00000100:00100000:2.0:1776191049.984308:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1462
00000100:00100000:2.0:1776191049.984314:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002271bdf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630848640:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191049.984335:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191049.984374:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002271bdf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630848640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (155us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191049.984381:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1462
00000100:00100000:2.0:1776191049.984436:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630848256
00000100:00100000:2.0:1776191049.984459:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1874
00000100:00100000:2.0:1776191049.984463:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007984aea6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630848256:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191049.984499:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007984aea6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630848256:12345-0@lo:400:kworker/u8:4.0 Request processed in 35us (422us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191049.984505:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1874
00000100:00100000:1.0:1776191049.990910:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008b75dd33 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630848192:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191049.990938:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001d2d29b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630848576:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191049.991955:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007582ba84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630848064:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191049.993547:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f135e4dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630848320:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191049.993566:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e23238ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630848128:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191049.993577:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f92aa327 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630848512:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191049.999917:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ca7e4d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630848000:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191049.999934:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d84ee367 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630848256:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191049.999976:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd36ba63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630848640:0@lo:13:osp-pre-0-0.0
00010000:00010000:0.0:1776191050.752950:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191051.617235:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191051.617286:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191051.617336:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191051.617376:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191051.617422:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191051.617447:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613776064
00000100:00100000:0.0:1776191051.617478:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613776128
00000100:00100000:0.0:1776191051.617511:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1875
00000100:00100000:0.0:1776191051.617518:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f135e4dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613776064:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191051.617551:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f135e4dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613776064:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 34us (176us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191051.617558:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1875
00000100:00100000:0.0:1776191051.617581:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2106
00000100:00100000:0.0:1776191051.617585:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000020a1d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613776128:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:0.0:1776191051.617686:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191051.617724:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000020a1d105 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613776128:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 138us (304us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191051.617730:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2106
00000100:00100000:1.0:1776191051.619831:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613775936
00000100:00100000:1.0:1776191051.619895:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613776000
00000100:00100000:1.0:1776191051.619934:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4246
00000100:00100000:1.0:1776191051.619940:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f92aa327 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613775936:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191051.620014:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f92aa327 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613775936:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 72us (2728us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191051.620023:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4246
00010000:00010000:0.0:1776191051.770250:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191052.794408:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191053.050422:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd36ba63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630848768:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191053.050497:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191053.050614:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630848768
00000100:00100000:2.0:1776191053.050673:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2897
00000100:00100000:2.0:1776191053.050680:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000006c85329 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630848768:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191053.050718:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191053.050857:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000006c85329 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630848768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 176us (360us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191053.050864:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2897
00000100:00100000:1.0:1776191054.076172:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000059d0f50d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630848832:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191054.076240:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191054.076408:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630848832
00000100:00100000:2.0:1776191054.076462:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2898
00000100:00100000:2.0:1776191054.076468:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036033aa5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630848832:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191054.076503:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191054.076552:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036033aa5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630848832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (313us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191054.076559:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2898
00000100:00100000:1.0:1776191054.076697:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000059d0f50d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630848832:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191054.842427:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191055.098228:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191055.098250:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008074d522 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630848896:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191055.098322:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191055.098354:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776191055.098374:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630848896
00000100:00100000:2.0:1776191055.098375:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ab7db222 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630848960:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191055.098410:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191055.098598:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630848960
00000100:00100000:1.0:1776191055.098635:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1463
00000100:00100000:1.0:1776191055.098642:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000abb7dbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630848896:12345-0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1776191055.098645:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191055.098652:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191055.098655:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191055.098661:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3588
00000100:00080000:0.0:1776191055.098663:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191055.098668:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00002000:00000024:1.0:1776191055.098673:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191055.098690:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000006b341218 x1862467630849344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191055.098706:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191055.098709:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191055.098710:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191055.098715:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3588
00000100:00080000:0.0:1776191055.098717:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00100000:1.0:1776191055.098717:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000abb7dbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630848896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (392us total) trans 0 rc 0/0
00000100:00080000:0.0:1776191055.098721:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191055.098731:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000028cc0665 x1862467630849408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191055.098735:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1463
00000100:00100000:1.0:1776191055.098759:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1464
00000100:00100000:0.0:1776191055.098763:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d84ee367 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630849024:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191055.098766:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006c69c74b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630848960:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191055.098787:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191055.098792:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191055.098818:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000075933c7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630849280:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191055.098826:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006c69c74b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630848960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (416us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191055.098836:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1464
00000100:00100000:0.0:1776191055.098847:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191055.098860:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006b341218 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630849344:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191055.098879:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ab7db222 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630848960:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191055.098893:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191055.098899:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191055.098905:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dbd40b9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630849216:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191055.098929:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028cc0665 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630849408:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191055.098936:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191055.098960:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191055.098969:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008b75dd33 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630849152:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191055.098997:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191055.099014:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037d4716c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630849536:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191055.099057:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191055.099072:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:0.0:1776191055.099077:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001d2d29b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630849088:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191055.099097:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191055.099111:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045d4856e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630849472:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191055.099130:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191055.099153:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630849216
00000100:00100000:1.0:1776191055.099734:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630849024
00000100:00100000:0.0:1776191055.100694:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630849536
00000100:00100000:0.0:1776191055.100725:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630849088
00000100:00100000:0.0:1776191055.100741:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630849472
00000100:00100000:0.0:1776191055.100760:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4248
00000100:00100000:0.0:1776191055.100765:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c1011c34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630849216:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191055.101127:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4249
00000100:00100000:2.0:1776191055.101134:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081ef8bd2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630849536:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191055.101158:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c1011c34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630849216:12345-0@lo:400:kworker/u8:4.0 Request processed in 391us (2221us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191055.101168:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4248
00000100:00100000:0.0:1776191055.101186:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4250
00000100:00100000:0.0:1776191055.101190:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae6c8b4c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630849088:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191055.101232:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081ef8bd2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630849536:12345-0@lo:400:kworker/u8:4.0 Request processed in 97us (2174us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191055.101234:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae6c8b4c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630849088:12345-0@lo:400:kworker/u8:4.0 Request processed in 41us (2135us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191055.101244:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4249
00000100:00100000:0.0:1776191055.101251:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4250
00000100:00100000:2.0:1776191055.101264:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4251
00000100:00100000:2.0:1776191055.101270:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000037cd311c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630849472:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191055.101300:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000037cd311c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630849472:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (2171us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191055.101320:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4251
00000100:00100000:2.0:1776191055.101353:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630849280
00000100:00100000:2.0:1776191055.101384:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630849152
00000100:00100000:0.0:1776191055.101397:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dbd40b9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630849216:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191055.101402:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2899
00000100:00100000:2.0:1776191055.101408:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000603b89b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630849280:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191055.101439:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2108
00000100:00100000:0.0:1776191055.101445:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000615cbccf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630849408:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191055.101451:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000603b89b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630849280:12345-0@lo:400:kworker/u8:4.0 Request processed in 40us (2602us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191055.101457:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2899
00000100:00100000:2.0:1776191055.101473:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2900
00000100:00100000:1.0:1776191055.101474:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1614
00000100:00100000:2.0:1776191055.101479:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f8de323 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630849152:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191055.101485:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb953a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630849024:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191055.101508:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f8de323 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630849152:12345-0@lo:400:kworker/u8:4.0 Request processed in 29us (2511us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191055.101515:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2900
00000100:00100000:1.0:1776191055.101533:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb953a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630849024:12345-0@lo:400:kworker/u8:4.0 Request processed in 49us (2740us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191055.101541:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1614
00000100:00100000:2.0:1776191055.101585:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001d2d29b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630849088:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191055.101600:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045d4856e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630849472:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191055.101615:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008b75dd33 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630849152:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191055.101632:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008074d522 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630848896:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191055.101633:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037d4716c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630849536:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191055.101688:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d84ee367 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630849024:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191055.101706:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000075933c7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630849280:0@lo:400:kworker/u8:4.0
00010000:02020000:0.0:1776191055.101743:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191055.101855:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000615cbccf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630849408:12345-0@lo:8:kworker/u8:4.0 Request processed in 409us (2896us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191055.101871:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2108
00010000:00010000:0.0:1776191055.866214:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191056.732925:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191056.732969:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191056.732999:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191056.733076:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191056.733111:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613776384
00000100:00100000:0.0:1776191056.733154:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1876
00000100:00100000:0.0:1776191056.733161:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008b75dd33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613776384:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191056.733230:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008b75dd33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613776384:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 68us (195us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191056.733238:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1876
00000100:00100000:1.0:1776191056.733441:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613776256
00000100:00100000:1.0:1776191056.733478:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613776320
00000100:00100000:1.0:1776191056.733500:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4252
00000100:00100000:1.0:1776191056.733505:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000075933c7b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613776256:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191056.733540:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000075933c7b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613776256:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 34us (571us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191056.733546:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4252
00000100:00100000:1.0:1776191056.733560:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4253
00000100:00100000:1.0:1776191056.733565:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d84ee367 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613776320:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191056.733588:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d84ee367 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613776320:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 23us (589us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191056.733594:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4253
00000100:00100000:2.0:1776191056.733881:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613776192
00000100:00100000:2.0:1776191056.733926:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1615
00000100:00100000:2.0:1776191056.733930:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a5cfa2a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613776192:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191056.733972:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a5cfa2a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613776192:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 40us (1054us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191056.733978:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1615
00000100:00100000:0.0:1776191056.735288:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00010000:00010000:0.0:1776191057.914741:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191058.172597:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776191058.172621:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ab0b0aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630849600:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191058.172689:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191058.175551:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630849600
00000100:00100000:2.0:1776191058.175666:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2901
00000100:00100000:2.0:1776191058.175671:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008074d522 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630849600:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191058.175715:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191058.175792:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008074d522 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630849600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (3104us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191058.175797:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2901
00000100:00100000:1.0:1776191058.175892:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ab0b0aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630849600:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191058.938246:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191059.195422:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191059.195437:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000604d7be5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630849664:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191059.195501:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191059.195623:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630849664
00000100:00100000:2.0:1776191059.195709:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2902
00000100:00100000:2.0:1776191059.195714:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dbd40b9d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630849664:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191059.195745:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191059.195804:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dbd40b9d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630849664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (304us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191059.195812:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2902
00000100:00100000:0.0:1776191059.195879:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000604d7be5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630849664:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191060.218654:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7c58b5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630849728:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191060.218724:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006b668658 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630849792:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191060.218839:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5f2099 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630849920:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191060.222878:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191060.222902:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630849984:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191060.222933:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191060.222956:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630849984
00000100:00100000:1.0:1776191060.222978:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2904
00000100:00100000:1.0:1776191060.222981:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa646f87 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630849984:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191060.223024:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa646f87 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630849984:12345-0@lo:400:kworker/u8:2.0 Request processed in 41us (90us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191060.223030:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2904
00000100:00100000:1.0:1776191060.223069:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000150035b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630850368:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191060.223097:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191060.223119:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7c58b5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630849728:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191060.223129:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630849984:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191060.223144:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191060.223150:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093a782ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630850432:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191060.223171:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191060.223191:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630850432
00000100:00100000:1.0:1776191060.223221:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1466
00000100:00100000:1.0:1776191060.223225:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000011d3c5e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630850432:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191060.223237:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191060.223262:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000011d3c5e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630850432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (91us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191060.223268:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1466
00000100:00100000:1.0:1776191060.223288:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000150035b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630850368:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191060.223412:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191060.223471:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000939787e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630850048:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191060.223496:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191060.223521:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630850048
00000100:00100000:0.0:1776191060.223543:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1878
00000100:00100000:0.0:1776191060.223547:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de9cc0f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630850048:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191060.223574:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de9cc0f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630850048:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (78us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191060.223579:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1878
00000100:00100000:0.0:1776191060.223603:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000939787e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630850048:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191060.223718:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191060.223746:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093a782ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630850432:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191060.223776:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000070835139 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630850304:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191060.223800:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191060.225990:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006b668658 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630849792:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191060.226350:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5f2099 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630849920:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191060.226501:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630850304
00000100:00100000:1.0:1776191060.226562:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4257
00000100:00100000:1.0:1776191060.226569:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ab0b0aa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630850304:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191060.226645:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ab0b0aa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630850304:12345-0@lo:400:kworker/u8:2.0 Request processed in 76us (2845us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191060.226653:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4257
00000100:00100000:2.0:1776191060.229354:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000070835139 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630850304:0@lo:400:kworker/u8:2.0
00010000:00010000:0.0:1776191060.987805:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191061.851262:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191061.851743:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191061.852257:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191061.852732:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191061.852779:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613776704
00000100:00100000:1.0:1776191061.852826:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1879
00000100:00100000:1.0:1776191061.852833:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe4d38b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613776704:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191061.852890:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe4d38b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613776704:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 57us (633us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191061.852981:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613776576
00000100:00100000:2.0:1776191061.853016:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613776640
00000100:00100000:2.0:1776191061.853060:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4258
00000100:00100000:2.0:1776191061.853066:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd51018c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613776576:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191061.853097:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd51018c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613776576:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 31us (1356us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191061.853105:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4258
00000100:00100000:1.0:1776191061.853262:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1879
00000100:00100000:1.0:1776191061.853761:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613776768
00000100:00100000:1.0:1776191061.853786:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2112
00000100:00100000:1.0:1776191061.853790:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000045cfbe50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613776768:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:1.0:1776191061.853909:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191061.853955:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000045cfbe50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613776768:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 163us (520us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191061.853962:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2112
00010000:00010000:0.0:1776191062.010440:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191063.290472:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ab7db222 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630850560:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191063.290540:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191063.297262:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ab7db222 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630850560:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191064.058235:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191064.314476:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000059d0f50d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630850624:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191064.314545:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191064.315009:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000059d0f50d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630850624:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191065.082298:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191065.338586:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5f2099 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630850688:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191065.338655:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191065.338848:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630850752
00000100:00100000:0.0:1776191065.338887:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1618
00000100:00100000:0.0:1776191065.338893:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c42de81a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630850752:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191065.340306:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630850688
00000100:00100000:2.0:1776191065.340344:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1467
00000100:00100000:2.0:1776191065.340350:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b8ca8296 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630850688:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191065.340378:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191065.340416:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b8ca8296 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630850688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (1762us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191065.340423:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1467
00000100:00100000:2.0:1776191065.340447:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd36ba63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630850816:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191065.340469:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191065.340599:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630850816
00000100:00100000:2.0:1776191065.340623:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1468
00000100:00100000:2.0:1776191065.340627:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000059d0f50d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630850816:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191065.340638:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191065.340672:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000059d0f50d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630850816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (202us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191065.340678:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1468
00000100:00080000:1.0:1776191065.340868:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191065.340873:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191065.340876:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191065.340881:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3598
00000100:00080000:1.0:1776191065.340883:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191065.341066:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191065.341100:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000007f6f66ba x1862467630851136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191065.341121:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191065.341124:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191065.341125:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191065.341129:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3598
00000100:00080000:1.0:1776191065.341130:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191065.341134:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191065.341145:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000a0236b56 x1862467630851200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191065.341190:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f6f66ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630851136:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191065.341226:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191065.341245:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a0236b56 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630851200:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191065.341265:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191065.341297:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630851136
00000100:00100000:1.0:1776191065.341320:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630851200
00000100:00100000:1.0:1776191065.341393:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2113
00000100:00100000:1.0:1776191065.341397:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c243e42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630851136:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191065.341489:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191065.341524:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c243e42 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630851136:12345-0@lo:8:kworker/u8:4.0 Request processed in 126us (297us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191065.341531:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2113
00000100:00100000:1.0:1776191065.341551:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2114
00000100:00100000:1.0:1776191065.341554:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c904ec5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630851200:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191065.341637:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191065.341664:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c904ec5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630851200:12345-0@lo:8:kworker/u8:4.0 Request processed in 109us (399us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191065.341669:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2114
00000100:00100000:1.0:1776191065.341687:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000615cbccf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630850880:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191065.341711:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191065.341725:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000012367763 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630851264:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191065.341743:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191065.341759:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:1.0:1776191065.341765:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a27cd066 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630850944:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191065.341799:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191065.341815:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bb77a7ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630851328:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191065.341832:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191065.341857:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630851008
00000100:00100000:1.0:1776191065.341882:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630850880
00000100:00100000:1.0:1776191065.341914:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630851264
00000100:00100000:1.0:1776191065.341932:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630851328
00000100:00100000:1.0:1776191065.341944:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4260
00000100:00100000:1.0:1776191065.341948:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b668658 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630851008:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191065.341982:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b668658 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630851008:12345-0@lo:400:kworker/u8:4.0 Request processed in 33us (1784us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191065.341988:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4260
00000100:00100000:1.0:1776191065.342000:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4261
00000100:00100000:1.0:1776191065.342003:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048d62137 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630850880:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191065.342031:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048d62137 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630850880:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (320us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191065.342059:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4261
00000100:00100000:1.0:1776191065.342072:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4262
00000100:00100000:1.0:1776191065.342075:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000690142e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630851264:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191065.342112:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000690142e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630851264:12345-0@lo:400:kworker/u8:4.0 Request processed in 35us (368us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191065.342120:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4262
00000100:00100000:1.0:1776191065.342132:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4263
00000100:00100000:1.0:1776191065.342135:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe1c3a77 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630851328:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191065.342158:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe1c3a77 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630851328:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (325us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191065.342165:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4263
00000100:00100000:1.0:1776191065.342187:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630850944
00000100:00100000:1.0:1776191065.342209:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2907
00000100:00100000:1.0:1776191065.342213:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b824a572 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630850944:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191065.342239:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b824a572 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630850944:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (440us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191065.342244:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2907
00000100:00080000:1.0:1776191065.342275:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191065.342278:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191065.342282:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f6f66ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630851136:0@lo:8:kworker/u8:4.0
00000100:00080000:1.0:1776191065.342290:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191065.342292:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191065.342294:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a0236b56 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630851200:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191065.342331:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5f2099 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630850688:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191065.342353:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a27cd066 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630850944:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191065.342361:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bb77a7ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630851328:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191065.342369:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000615cbccf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630850880:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191065.342376:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000012367763 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630851264:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191065.344069:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd36ba63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630850816:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191065.344115:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1bce22f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630851072:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191065.344169:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191065.344294:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c42de81a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630850752:12345-0@lo:400:kworker/u8:4.0 Request processed in 5399us (5560us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191065.344305:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1618
00000100:00100000:1.0:1776191065.344629:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630851072
00000100:00100000:1.0:1776191065.344671:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2908
00000100:00100000:1.0:1776191065.344677:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bd36ba63 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630851072:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191065.344738:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bd36ba63 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630851072:12345-0@lo:400:kworker/u8:4.0 Request processed in 61us (570us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191065.344745:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2908
00000100:00100000:0.0:1776191066.970395:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191066.970472:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613776832
00000100:00100000:2.0:1776191066.970537:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1619
00000100:00100000:2.0:1776191066.970547:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc7ff80b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613776832:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191066.970622:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc7ff80b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613776832:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 76us (235us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191066.970630:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1619
00000100:00100000:0.0:1776191066.972178:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191066.972216:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191066.972251:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191066.972312:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191066.972447:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613777088
00000100:00100000:1.0:1776191066.972499:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613777024
00000100:00100000:2.0:1776191066.972541:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613776896
00000100:00100000:1.0:1776191066.972543:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1880
00000100:00100000:1.0:1776191066.972551:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005da74066 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613777024:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191066.972576:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613776960
00000100:00100000:2.0:1776191066.972599:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4264
00000100:00100000:2.0:1776191066.972604:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000061591e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613776896:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191066.972629:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005da74066 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613777024:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 77us (316us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191066.972638:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1880
00000100:00100000:2.0:1776191066.972643:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000061591e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613776896:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 36us (471us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191066.972652:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4264
00000100:00100000:1.0:1776191066.972659:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2115
00000100:00100000:1.0:1776191066.972664:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b7fdcd77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613777088:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00000100:00100000:2.0:1776191066.972672:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4265
00000100:00100000:2.0:1776191066.972677:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000368387b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613776960:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191066.972698:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000368387b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613776960:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 21us (483us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191066.972703:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4265
00010000:02020000:1.0:1776191066.972757:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191066.972793:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b7fdcd77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613777088:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 128us (541us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191066.972803:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2115
00010000:00010000:0.0:1776191067.130494:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191068.154337:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191068.410423:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630851392
00000100:00100000:2.0:1776191068.410558:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2909
00000100:00100000:2.0:1776191068.410565:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5f2099 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630851392:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191068.410599:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191068.410657:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5f2099 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630851392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (327us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191068.410665:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2909
00000100:00100000:1.0:1776191069.434454:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630851456
00000100:00100000:1.0:1776191069.434540:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2910
00000100:00100000:1.0:1776191069.434547:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af1b2795 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630851456:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191069.434578:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191069.434639:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af1b2795 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630851456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (294us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191069.434646:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2910
00010000:00010000:0.0:1776191070.202318:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191070.458225:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093a782ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630851520:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191070.458306:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1776191070.458322:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191070.458330:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191070.458333:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191070.458339:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3603
00000100:00080000:0.0:1776191070.458341:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191070.458346:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191070.458359:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d48583e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630851712:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191070.458366:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000005e63aab7 x1862467630852096/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191070.458381:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191070.458384:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191070.458386:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191070.458389:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3603
00000100:00080000:0.0:1776191070.458390:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00100000:2.0:1776191070.458392:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1776191070.458393:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191070.458402:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000076ea9d35 x1862467630852160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191070.458416:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ee2fc84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630851968:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191070.458440:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191070.458457:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [2->3]
00000100:00100000:2.0:1776191070.458463:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002200bdf2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630851648:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191070.458490:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191070.458505:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029e81afd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630851904:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191070.458526:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191070.458539:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000002f18e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630852288:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191070.458558:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191070.458584:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630851648
00000100:00100000:2.0:1776191070.458607:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1620
00000100:00100000:2.0:1776191070.458611:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bcb4f46f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630851648:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191070.458668:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bcb4f46f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630851648:12345-0@lo:400:kworker/u8:4.0 Request processed in 56us (177us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191070.458675:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fe4d38b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630851776:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191070.458677:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1620
00000100:00100000:1.0:1776191070.458710:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191070.458719:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630851712
00000100:00100000:1.0:1776191070.458731:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005c5a025e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630852032:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191070.458744:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630852288
00000100:00100000:2.0:1776191070.458767:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4266
00000100:00100000:1.0:1776191070.458772:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191070.458775:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007984aea6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630851712:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191070.458792:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [1->0]
00000100:00100000:1.0:1776191070.458800:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c95e149a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630851584:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191070.458814:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007984aea6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630851712:12345-0@lo:400:kworker/u8:4.0 Request processed in 39us (420us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191070.458821:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4266
00000100:00100000:1.0:1776191070.458829:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191070.458837:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4267
00000100:00100000:2.0:1776191070.458841:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b341218 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630852288:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191070.458866:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b341218 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630852288:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (308us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191070.458872:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4267
00000100:00100000:2.0:1776191070.458907:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002200bdf2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630851648:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191070.458918:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000002f18e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630852288:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191070.458926:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d48583e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630851712:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191070.458933:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ee2fc84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630851968:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191070.458987:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630851904
00000100:00100000:2.0:1776191070.459008:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630851776
00000100:00100000:2.0:1776191070.459018:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2911
00000100:00100000:2.0:1776191070.459021:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028cc0665 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630851904:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191070.459074:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028cc0665 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630851904:12345-0@lo:400:kworker/u8:4.0 Request processed in 53us (548us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191070.459079:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2911
00000100:00100000:2.0:1776191070.459091:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2912
00000100:00100000:2.0:1776191070.459093:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c634116b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630851776:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191070.459118:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c634116b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630851776:12345-0@lo:400:kworker/u8:4.0 Request processed in 24us (410us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191070.459123:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2912
00000100:00100000:2.0:1776191070.459149:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029e81afd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630851904:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191070.459270:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005c8cf6d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630851840:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191070.459295:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191070.459311:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630852224:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191070.459342:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191070.459363:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fe4d38b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630851776:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191070.459373:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630851520
00000100:00100000:1.0:1776191070.459376:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005c5a025e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630852032:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191070.459407:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630851584
00000100:00100000:1.0:1776191070.459414:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630851840
00000100:00100000:0.0:1776191070.459431:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1469
00000100:00100000:0.0:1776191070.459436:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ea65731 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630851520:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191070.459445:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630852224
00002000:00000024:0.0:1776191070.459459:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191070.459467:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4268
00000100:00100000:1.0:1776191070.459472:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000989821a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630851840:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191070.459504:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ea65731 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630851520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (1200us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191070.459511:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1469
00000100:00100000:1.0:1776191070.459518:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000989821a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630851840:12345-0@lo:400:kworker/u8:4.0 Request processed in 43us (221us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191070.459526:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470
00000100:00100000:1.0:1776191070.459527:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4268
00000100:00100000:0.0:1776191070.459533:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000455a3f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630851584:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191070.459543:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191070.459554:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4269
00000100:00100000:1.0:1776191070.459559:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000615cbccf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630852224:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191070.459569:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000455a3f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630851584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (741us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191070.459576:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470
00000100:00100000:1.0:1776191070.459593:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000615cbccf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630852224:12345-0@lo:400:kworker/u8:4.0 Request processed in 33us (250us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191070.459600:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4269
00000100:00100000:1.0:1776191070.459643:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c95e149a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630851584:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191070.459651:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005c8cf6d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630851840:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191070.459659:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630852224:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191070.459683:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093a782ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630851520:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191070.459766:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630852096
00000100:00100000:1.0:1776191070.459790:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2116
00000100:00100000:1.0:1776191070.459796:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070835139 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630852096:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191070.460248:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191070.460299:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070835139 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630852096:12345-0@lo:8:kworker/u8:4.0 Request processed in 501us (607us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191070.460310:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2116
00010000:00010000:0.0:1776191071.227188:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191072.092307:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613777216
00000100:00100000:0.0:1776191072.092358:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4270
00000100:00100000:0.0:1776191072.092365:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c95e149a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613777216:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191072.092437:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c95e149a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613777216:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 71us (252us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191072.092446:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4270
00000100:00100000:0.0:1776191072.092462:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613777280
00000100:00100000:0.0:1776191072.092479:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4271
00000100:00100000:0.0:1776191072.092483:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a6d843e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613777280:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191072.092491:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613777408
00000100:00100000:0.0:1776191072.092509:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a6d843e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613777280:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 24us (119us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191072.092515:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4271
00000100:00100000:1.0:1776191072.092520:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613777344
00000100:00100000:2.0:1776191072.092546:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613777152
00000100:00100000:1.0:1776191072.092557:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1883
00000100:00100000:1.0:1776191072.092562:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000939787e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613777344:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191072.092585:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1621
00000100:00100000:2.0:1776191072.092594:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ac96f048 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613777152:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191072.092595:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000939787e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613777344:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 30us (280us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191072.092606:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1883
00000100:00100000:2.0:1776191072.092632:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ac96f048 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613777152:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 38us (279us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191072.092646:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1621
00010000:00010000:0.0:1776191073.274269:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191073.532356:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630852352
00000100:00100000:1.0:1776191073.532456:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2913
00000100:00100000:1.0:1776191073.532463:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a426c55 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630852352:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191073.532498:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191073.532564:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a426c55 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630852352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (1184us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191073.532570:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2913
00010000:00010000:0.0:1776191074.299815:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191074.554518:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630852416
00000100:00100000:0.0:1776191074.554566:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2914
00000100:00100000:0.0:1776191074.554571:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030c9704c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630852416:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191074.554600:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191074.554660:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030c9704c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630852416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (196us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191074.554668:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2914
00000100:00100000:0.0:1776191075.578264:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a27cd066 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630852480:0@lo:400:kworker/u8:4.0
00000100:00080000:1.0:1776191075.578272:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191075.578279:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191075.578282:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191075.578287:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3608
00000100:00080000:1.0:1776191075.578290:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191075.578296:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191075.578319:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000006eae40ed x1862467630852992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191075.578336:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191075.578338:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191075.578340:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191075.578343:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3608
00000100:00080000:1.0:1776191075.578345:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191075.578349:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191075.578354:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191075.578362:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000cc0a67c2 x1862467630853056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191075.578388:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a0236b56 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630852736:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191075.578397:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000012367763 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630852608:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191075.578430:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191075.578446:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630852480
00000100:00100000:1.0:1776191075.578483:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1622
00000100:00100000:1.0:1776191075.578488:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b37044fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630852480:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191075.578637:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630852736
00000100:00100000:2.0:1776191075.578667:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2915
00000100:00100000:2.0:1776191075.578670:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a8e91aa5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630852736:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191075.582663:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eb0e72b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630853120:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191075.582693:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191075.583065:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b37044fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630852480:12345-0@lo:400:kworker/u8:4.0 Request processed in 4574us (4715us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191075.583069:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a8e91aa5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630852736:12345-0@lo:400:kworker/u8:4.0 Request processed in 4394us (4638us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191075.583080:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1622
00000100:00100000:2.0:1776191075.583083:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2915
00000100:00100000:0.0:1776191075.583370:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a0236b56 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630852736:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191075.583380:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a27cd066 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630852480:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191075.588615:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eb0e72b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630853120:0@lo:400:kworker/u8:4.0
00010000:00010000:0.0:1776191076.346708:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191077.214365:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613777600
00000100:00100000:2.0:1776191077.214412:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613777536
00000100:00100000:2.0:1776191077.214442:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4276
00000100:00100000:2.0:1776191077.214449:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2eb5de3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613777600:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191077.214527:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2eb5de3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613777600:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 77us (360us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191077.214535:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4276
00000100:00100000:2.0:1776191077.214555:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4277
00000100:00100000:2.0:1776191077.214559:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009e7f18ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613777536:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191077.214583:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009e7f18ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613777536:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 23us (377us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191077.214589:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4277
00000100:00100000:1.0:1776191077.214688:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613777472
00000100:00100000:1.0:1776191077.214723:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1623
00000100:00100000:1.0:1776191077.214728:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004e50600 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613777472:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191077.214755:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004e50600 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613777472:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 26us (609us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191077.214761:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1623
00000100:00100000:0.0:1776191077.216991:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613777728
00000100:00100000:0.0:1776191077.217154:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613777664
00000100:00100000:0.0:1776191077.217401:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1886
00000100:00100000:0.0:1776191077.217409:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f6f66ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613777664:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191077.217568:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f6f66ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613777664:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 158us (3338us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191077.217576:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1886
00000100:00100000:0.0:1776191077.217593:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2121
00000100:00100000:0.0:1776191077.217597:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007582ba84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613777728:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:0.0:1776191077.217696:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191077.217720:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007582ba84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613777728:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 122us (3744us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191077.217727:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2121
00010000:00010000:0.0:1776191077.370843:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191078.651061:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630853312
00000100:00100000:0.0:1776191078.651101:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2917
00000100:00100000:0.0:1776191078.651107:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1bce22f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630853312:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191078.651139:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191078.651187:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1bce22f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630853312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (175us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191078.651194:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2917
00010000:00010000:0.0:1776191079.418302:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191079.675081:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776191079.675106:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037d4716c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630853376:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191079.675182:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191079.675476:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630853376
00000100:00100000:1.0:1776191079.675517:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2918
00000100:00100000:1.0:1776191079.675522:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000045d4856e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630853376:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191079.675552:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191079.678215:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000045d4856e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630853376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2685us (3029us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191079.678229:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2918
00000100:00100000:2.0:1776191079.678378:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037d4716c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630853376:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191080.444711:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1776191080.698629:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191080.698637:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191080.698641:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191080.698648:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3613
00000100:00080000:0.0:1776191080.698652:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191080.698657:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191080.698675:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000039985528 x1862467630853888/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191080.698691:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191080.698694:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191080.698696:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191080.698699:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3613
00000100:00080000:0.0:1776191080.698701:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191080.698705:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191080.698715:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000007f2ed044 x1862467630853952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191080.698804:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a27cd066 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630853440:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191080.698844:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191080.698869:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004f09a8ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630853696:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191080.698902:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191080.698919:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bf7cf36f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630854080:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191080.698946:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191080.698964:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [3->2]
00000100:00100000:0.0:1776191080.698971:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d7418614 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630853504:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191080.698994:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191080.699009:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006165bc89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630853760:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191080.699029:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191080.699074:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc2bbe9c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630854144:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191080.699100:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191080.699129:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630853440
00000100:00100000:0.0:1776191080.699161:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1624
00000100:00100000:0.0:1776191080.699167:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f9005e31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630853440:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191080.699222:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f9005e31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630853440:12345-0@lo:400:kworker/u8:4.0 Request processed in 55us (380us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191080.699229:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1624
00000100:00100000:0.0:1776191080.699258:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630854080
00000100:00100000:0.0:1776191080.699278:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630853504
00000100:00100000:0.0:1776191080.699292:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4278
00000100:00100000:0.0:1776191080.699296:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009f44bd72 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630854080:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191080.699324:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009f44bd72 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630854080:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (378us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191080.699330:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4278
00000100:00100000:0.0:1776191080.699341:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4279
00000100:00100000:0.0:1776191080.699344:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000118d0482 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630853504:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191080.699366:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000118d0482 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630853504:12345-0@lo:400:kworker/u8:4.0 Request processed in 21us (372us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191080.699371:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4279
00000100:00100000:1.0:1776191080.699451:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630853696
00000100:00100000:1.0:1776191080.699481:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2919
00000100:00100000:1.0:1776191080.699485:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de454674 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630853696:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191080.699495:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dcce9244 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630853568:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191080.699536:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191080.699539:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de454674 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630853696:12345-0@lo:400:kworker/u8:4.0 Request processed in 52us (638us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191080.699546:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2919
00000100:00100000:2.0:1776191080.699559:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fd716f95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630853824:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191080.699561:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630853568
00000100:00100000:1.0:1776191080.699578:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2920
00000100:00100000:1.0:1776191080.699583:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000037d4716c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630853568:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191080.699588:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191080.699599:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000012367763 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630854208:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191080.699615:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000037d4716c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630853568:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (80us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191080.699622:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2920
00000100:00100000:2.0:1776191080.699626:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191080.699643:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630854144
00000100:00100000:2.0:1776191080.699668:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dcce9244 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630853568:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191080.699669:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630854208
00000100:00100000:2.0:1776191080.699687:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:1.0:1776191080.699690:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1473
00000100:00100000:1.0:1776191080.699696:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001425031c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630854144:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191080.699697:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000042bf922a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630853632:0@lo:400:kworker/u8:4.0
00002000:00000024:1.0:1776191080.699719:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191080.699729:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191080.699759:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008ba1222e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630854016:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191080.699769:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001425031c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630854144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (669us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191080.699777:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1473
00000100:00100000:2.0:1776191080.699787:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191080.699792:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1474
00000100:00100000:1.0:1776191080.699798:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e63aab7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630854208:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191080.699808:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191080.699819:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630853632
00000100:00100000:1.0:1776191080.699839:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e63aab7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630854208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (215us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191080.699847:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1474
00000100:00100000:2.0:1776191080.699849:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630854016
00000100:00100000:2.0:1776191080.699875:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4280
00000100:00100000:1.0:1776191080.699877:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630853824
00000100:00100000:2.0:1776191080.699880:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c8cf6d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630853632:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191080.699912:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c8cf6d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630853632:12345-0@lo:400:kworker/u8:4.0 Request processed in 33us (185us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191080.699918:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4280
00000100:00100000:2.0:1776191080.699932:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4281
00000100:00100000:2.0:1776191080.699935:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c5a025e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630854016:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191080.699959:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c5a025e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630854016:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (176us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191080.699965:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4281
00000100:00100000:2.0:1776191080.699996:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000042bf922a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630853632:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191080.700003:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008ba1222e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630854016:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191080.700015:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000012367763 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630854208:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191080.700195:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2122
00000100:00100000:0.0:1776191080.700210:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093a782ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630853888:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191080.700229:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2123
00000100:00100000:2.0:1776191080.700234:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a0236b56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630853952:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191080.701150:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:02020000:2.0:1776191080.701150:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191080.701214:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a0236b56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630853952:12345-0@lo:8:kworker/u8:4.0 Request processed in 978us (2338us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191080.701223:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2123
00000100:00100000:0.0:1776191080.701358:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093a782ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630853888:12345-0@lo:8:kworker/u8:4.0 Request processed in 1156us (2545us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191080.701366:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2122
00000100:00100000:0.0:1776191080.701437:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d7418614 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630853504:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191080.701450:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006165bc89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630853760:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191080.701464:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc2bbe9c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630854144:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191080.701472:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a27cd066 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630853440:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191080.701480:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004f09a8ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630853696:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191080.701489:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bf7cf36f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630854080:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191080.702627:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1888
00000100:00100000:1.0:1776191080.702634:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000076ea9d35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630853824:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191080.702766:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000076ea9d35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630853824:12345-0@lo:400:kworker/u8:4.0 Request processed in 132us (3178us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191080.702773:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1888
00000100:00080000:2.0:1776191080.703095:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191080.703100:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191080.703104:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000039985528 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630853888:0@lo:8:kworker/u8:4.0
00000100:00080000:2.0:1776191080.703114:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191080.703116:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191080.703118:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f2ed044 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630853952:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191082.330611:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191082.330657:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191082.330787:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613777856
00000100:00100000:2.0:1776191082.330787:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613777792
00000100:00100000:2.0:1776191082.330845:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1625
00000100:00100000:2.0:1776191082.330852:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000961e9bab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613777792:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191082.330879:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4282
00000100:00100000:0.0:1776191082.330884:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000020a1d105 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613777856:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191082.330925:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000961e9bab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613777792:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 73us (321us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191082.330932:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1625
00000100:00100000:0.0:1776191082.331553:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000020a1d105 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613777856:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 667us (894us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191082.331565:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4282
00000100:00100000:0.0:1776191082.332258:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191082.332294:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191082.332354:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613777920
00000100:00100000:2.0:1776191082.332388:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4283
00000100:00100000:2.0:1776191082.332392:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000073716db5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613777920:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191082.332413:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191082.332435:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000073716db5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613777920:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 41us (141us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191082.332441:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4283
00000100:00100000:1.0:1776191082.335103:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613778048
00000100:00100000:1.0:1776191082.335155:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613777984
00000100:00100000:1.0:1776191082.335314:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1889
00000100:00100000:1.0:1776191082.335321:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a27cd066 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613777984:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191082.335392:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a27cd066 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613777984:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 71us (2980us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191082.335400:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1889
00000100:00100000:1.0:1776191082.335418:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2124
00000100:00100000:1.0:1776191082.335421:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2a7dce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613778048:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:1.0:1776191082.335522:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191082.335548:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2a7dce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613778048:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 126us (3293us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191082.335555:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2124
00010000:00010000:0.0:1776191082.490323:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191083.514337:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191083.771355:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029e81afd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630854272:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191083.771423:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191083.771912:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630854272
00000100:00100000:1.0:1776191083.771965:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2921
00000100:00100000:1.0:1776191083.771971:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d5dde41 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630854272:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191083.772003:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191083.772087:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d5dde41 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630854272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (665us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191083.772095:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2921
00000100:00100000:0.0:1776191083.773408:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029e81afd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630854272:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191084.795132:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008b75dd33 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630854336:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191084.795203:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191084.797758:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630854336
00000100:00100000:2.0:1776191084.797969:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2922
00000100:00100000:2.0:1776191084.797977:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f43f1e37 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630854336:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191084.798015:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191084.798117:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f43f1e37 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630854336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (2915us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191084.798123:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2922
00000100:00100000:0.0:1776191084.798213:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008b75dd33 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630854336:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191085.562200:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191085.818324:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191085.818337:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bb77a7ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630854400:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191085.818340:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ee2fc84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630854464:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191085.818400:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191085.818437:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1776191085.818597:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191085.818601:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191085.818611:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000640b7818 x1862467630854976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191085.818692:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eb0e72b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630854592:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191085.818719:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191085.818734:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ecd900ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630854848:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191085.818755:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191085.818771:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:0.0:1776191085.818775:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc0a67c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630854656:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191085.818794:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191085.818807:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad386bcf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630855040:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191085.818824:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191085.818846:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000012367763 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630854528:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191085.818879:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191085.818893:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b92c4097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630854784:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191085.818981:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630854464
00000100:00100000:2.0:1776191085.819022:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630854400
00000100:00100000:2.0:1776191085.819058:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1475
00000100:00100000:1.0:1776191085.819059:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630854848
00000100:00100000:2.0:1776191085.819064:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029e81afd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630854464:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191085.819082:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1890
00000100:00100000:1.0:1776191085.819086:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002116724a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630854848:12345-0@lo:400:kworker/u8:2.0
00002000:00000024:2.0:1776191085.819094:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191085.819126:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029e81afd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630854464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (727us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191085.819132:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1475
00000100:00100000:0.0:1776191085.819263:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191085.819282:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:0.0:1776191085.819286:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006eae40ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630854720:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191085.819306:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191085.819318:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf2c1df6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630855104:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191085.819334:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191085.819625:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630854592
00000100:00100000:2.0:1776191085.819629:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1476
00000100:00100000:2.0:1776191085.819636:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000b9cbeaa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630854400:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191085.819660:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191085.819664:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630855040
00000100:00100000:0.0:1776191085.819681:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630854720
00000100:00100000:2.0:1776191085.819691:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000b9cbeaa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630854400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (1254us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191085.819697:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630855104
00000100:00100000:1.0:1776191085.819738:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002116724a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630854848:12345-0@lo:400:kworker/u8:2.0 Request processed in 650us (981us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191085.819745:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1890
00000100:00100000:1.0:1776191085.819772:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630854656
00000100:00100000:1.0:1776191085.819790:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630854784
00000100:00100000:1.0:1776191085.819801:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2923
00000100:00100000:1.0:1776191085.819804:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef14d805 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630854656:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191085.819832:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef14d805 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630854656:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (1037us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191085.819838:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2923
00000100:00100000:1.0:1776191085.819848:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2924
00000100:00100000:1.0:1776191085.819851:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ff26b50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630854784:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191085.819879:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ff26b50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630854784:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (616us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191085.819884:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2924
00000100:00100000:1.0:1776191085.819919:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b92c4097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630854784:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191085.819969:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4284
00000100:00100000:1.0:1776191085.819972:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093500675 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630854592:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191085.820002:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093500675 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630854592:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (1284us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191085.820010:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4284
00000100:00100000:1.0:1776191085.820023:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4285
00000100:00100000:1.0:1776191085.820026:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000079eea346 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630855040:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191085.820066:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000079eea346 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630855040:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (1241us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191085.820072:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4285
00000100:00100000:1.0:1776191085.820082:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4286
00000100:00100000:1.0:1776191085.820085:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004250bccf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630854720:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191085.820124:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004250bccf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630854720:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (816us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191085.820129:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4286
00000100:00100000:1.0:1776191085.820146:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630854528
00000100:00100000:1.0:1776191085.820168:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1626
00000100:00100000:1.0:1776191085.820172:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dce6a0d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630854528:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191085.820198:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dce6a0d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630854528:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (1318us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191085.820203:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1626
00000100:00100000:1.0:1776191085.820245:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006eae40ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630854720:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191085.820253:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000012367763 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630854528:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191085.820300:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc0a67c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630854656:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191085.820309:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad386bcf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630855040:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191085.820318:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eb0e72b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630854592:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191085.820326:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ecd900ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630854848:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191085.820338:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bb77a7ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630854400:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191085.820790:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4287
00000100:00100000:0.0:1776191085.820795:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e9827495 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630855104:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191085.820844:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e9827495 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630855104:12345-0@lo:400:kworker/u8:2.0 Request processed in 48us (1509us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191085.820850:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4287
00000100:00100000:0.0:1776191085.820882:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf2c1df6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630855104:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191085.820930:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028951562 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630854912:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191085.820963:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191085.820977:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000640b7818 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630854976:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191085.820992:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191085.821012:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630854912
00000100:00100000:0.0:1776191085.821031:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630854976
00000100:00100000:0.0:1776191085.821064:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2125
00000100:00100000:0.0:1776191085.821066:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000014441fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630854912:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191085.821234:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2126
00000100:00100000:1.0:1776191085.821237:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eefb5d99 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630854976:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:1.0:1776191085.821312:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191085.821341:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eefb5d99 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630854976:12345-0@lo:8:kworker/u8:2.0 Request processed in 103us (349us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191085.821346:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2126
00000100:00080000:1.0:1776191085.821391:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191085.821394:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191085.821397:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000640b7818 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630854976:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191085.821436:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ee2fc84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630854464:0@lo:13:osp-pre-0-0.0
00010000:02020000:0.0:1776191085.821507:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191085.821543:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000014441fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630854912:12345-0@lo:8:kworker/u8:2.0 Request processed in 475us (579us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191085.821549:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2125
00000100:00100000:2.0:1776191085.821964:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1476
00000100:00080000:1.0:1776191085.822725:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191085.822732:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191085.822737:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028951562 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630854912:0@lo:8:kworker/u8:2.0
00010000:00010000:0.0:1776191086.586733:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191087.453143:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191087.453704:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613778368
00000100:00100000:1.0:1776191087.453761:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2127
00000100:00100000:1.0:1776191087.453769:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006605fbf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613778368:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:1.0:1776191087.453877:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191087.453918:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191087.453951:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006605fbf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613778368:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 181us (814us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191087.453961:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2127
00000100:00100000:3.0:1776191087.453984:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613778112
00000100:00100000:3.0:1776191087.454027:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1627
00000100:00100000:3.0:1776191087.454098:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd42e839 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613778112:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191087.458557:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191087.458750:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613778240
00000100:00100000:2.0:1776191087.458810:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4288
00000100:00100000:2.0:1776191087.458817:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000021a52169 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613778240:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191087.458961:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000021a52169 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613778240:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 143us (412us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191087.458969:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4288
00000100:00100000:0.0:1776191087.459395:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191087.459440:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191087.459509:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613778176
00000100:00100000:2.0:1776191087.459545:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4289
00000100:00100000:2.0:1776191087.459549:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009af94ad9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613778176:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191087.459585:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009af94ad9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613778176:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 35us (192us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191087.459591:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4289
00000100:00100000:0.0:1776191087.459731:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613778304
00000100:00100000:0.0:1776191087.459763:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1891
00000100:00100000:0.0:1776191087.459769:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000caebeb11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613778304:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191087.459796:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000caebeb11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613778304:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 26us (357us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191087.459802:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1891
00000100:00100000:3.0:1776191087.461326:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd42e839 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613778112:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 7286us (7404us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191087.461340:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1627
00010000:00010000:3.0:1776191087.610628:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191088.634569:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191088.890387:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191088.890405:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ee2fc84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630855168:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191088.890473:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191088.890622:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630855168
00000100:00100000:3.0:1776191088.890672:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2925
00000100:00100000:3.0:1776191088.890678:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001d2d29b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630855168:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191088.890713:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191088.890765:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001d2d29b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630855168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (292us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191088.890773:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2925
00000100:00100000:1.0:1776191088.890981:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ee2fc84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630855168:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191089.658599:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191089.914355:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1776191089.914379:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008b75dd33 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630855232:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191089.914446:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191089.917479:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630855232
00000100:00100000:1.0:1776191089.917623:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2926
00000100:00100000:1.0:1776191089.917630:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007756d7ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630855232:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191089.917666:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191089.917743:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007756d7ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630855232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (3297us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191089.917750:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2926
00000100:00100000:3.0:1776191089.917835:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008b75dd33 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630855232:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191090.682280:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191090.938407:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1776191090.938423:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ee2fc84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630855296:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191090.938496:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191090.938557:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630855296
00000100:00100000:1.0:1776191090.938604:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000af393e55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630855360:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191090.938605:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477
00000100:00100000:3.0:1776191090.938614:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f2ed044 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630855296:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191090.938641:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00002000:00000024:3.0:1776191090.938648:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191090.938677:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630855360
00000100:00100000:3.0:1776191090.938696:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f2ed044 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630855296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (200us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191090.938706:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1478
00000100:00100000:1.0:1776191090.938725:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f135e4dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630855360:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191090.938737:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191090.938767:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f135e4dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630855360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (127us total) trans 0 rc 0/0
00000100:00080000:0.0:1776191090.939784:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191090.939788:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191090.939791:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191090.939796:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3623
00000100:00080000:0.0:1776191090.939798:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191090.939803:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191090.939819:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000b08e6b10 x1862467630855744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191090.939832:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191090.939835:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191090.939836:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191090.939839:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3623
00000100:00080000:0.0:1776191090.939840:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191090.939842:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191090.939849:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000e600ea8b x1862467630855808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191090.939880:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b2a1967f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630855424:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191090.939920:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191090.939939:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000032a96b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630855680:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191090.939959:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191090.939974:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191090.939978:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048ee9cec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630855616:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191090.939996:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191090.940014:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b08e6b10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630855744:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191090.940031:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191090.940057:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e600ea8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630855808:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191090.940072:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191090.940096:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630855424
00000100:00100000:0.0:1776191090.940124:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1628
00000100:00100000:0.0:1776191090.940129:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002224990e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630855424:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191090.940167:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002224990e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630855424:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (247us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191090.940173:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1628
00000100:00100000:0.0:1776191090.940213:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630855680
00000100:00100000:0.0:1776191090.940234:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2927
00000100:00100000:0.0:1776191090.940238:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3653833 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630855680:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191090.940268:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3653833 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630855680:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (308us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191090.940274:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2927
00000100:00100000:0.0:1776191090.940291:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630855616
00000100:00100000:0.0:1776191090.940313:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4290
00000100:00100000:0.0:1776191090.940316:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bf4604b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630855616:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191090.940343:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bf4604b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630855616:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (346us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191090.940349:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4290
00000100:00100000:0.0:1776191090.940365:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630855744
00000100:00100000:0.0:1776191090.940382:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630855808
00000100:00100000:0.0:1776191090.940396:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2128
00000100:00100000:0.0:1776191090.940399:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f97d550a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630855744:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191090.940491:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191090.940521:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f97d550a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630855744:12345-0@lo:8:kworker/u8:2.0 Request processed in 120us (489us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191090.940527:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2128
00000100:00100000:0.0:1776191090.940546:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2129
00000100:00100000:0.0:1776191090.940549:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000155ae841 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630855808:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191090.940630:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191090.940650:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000155ae841 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630855808:12345-0@lo:8:kworker/u8:2.0 Request processed in 100us (578us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191090.940655:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2129
00000100:00080000:0.0:1776191090.940691:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191090.940694:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191090.940697:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b08e6b10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630855744:0@lo:8:kworker/u8:2.0
00000100:00080000:0.0:1776191090.940703:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191090.940704:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191090.940706:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e600ea8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630855808:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191090.940729:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048ee9cec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630855616:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191090.940735:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b2a1967f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630855424:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191090.940740:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000032a96b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630855680:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191090.940787:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000af393e55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630855360:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191090.940808:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c7bea5f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630855552:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191090.940823:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ee2fc84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630855296:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191090.940834:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191090.940852:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d9f622e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630855936:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191090.940864:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000a10d073 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630855488:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191090.940872:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191090.940901:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630855936
00000100:00100000:2.0:1776191090.940901:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191090.940924:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055f4b7ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630855872:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191090.940927:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630855488
00000100:00100000:0.0:1776191090.940952:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4291
00000100:00100000:2.0:1776191090.940954:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191090.940959:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1967f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630855936:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191090.940999:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630855872
00000100:00100000:0.0:1776191090.941000:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1967f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630855936:12345-0@lo:400:kworker/u8:2.0 Request processed in 42us (129us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191090.941008:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4291
00000100:00100000:0.0:1776191090.941022:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4292
00000100:00100000:0.0:1776191090.941026:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000039985528 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630855488:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191090.941051:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4293
00000100:00100000:2.0:1776191090.941056:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd716f95 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630855872:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191090.941081:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000039985528 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630855488:12345-0@lo:400:kworker/u8:2.0 Request processed in 54us (181us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191090.941087:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4292
00000100:00100000:2.0:1776191090.941101:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd716f95 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630855872:12345-0@lo:400:kworker/u8:2.0 Request processed in 43us (150us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191090.941109:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4293
00000100:00100000:0.0:1776191090.941118:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630855552
00000100:00100000:0.0:1776191090.941143:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2928
00000100:00100000:0.0:1776191090.941147:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000032a96b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630855552:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191090.941149:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000a10d073 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630855488:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191090.941162:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055f4b7ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630855872:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191090.941185:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000032a96b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630855552:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (350us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191090.941192:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2928
00000100:00100000:0.0:1776191090.941220:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c7bea5f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630855552:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191090.941228:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d9f622e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630855936:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191090.942435:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477
00000100:00100000:1.0:1776191090.944215:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1478
00010000:00010000:0.0:1776191091.708144:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191092.574532:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191092.574580:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191092.574614:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191092.574645:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191092.574654:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613778496
00000100:00100000:2.0:1776191092.574689:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191092.574709:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613778560
00000100:00100000:2.0:1776191092.574721:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613778624
00000100:00100000:1.0:1776191092.574747:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4294
00000100:00100000:2.0:1776191092.574755:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613778688
00000100:00100000:1.0:1776191092.574756:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bf7cf36f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613778496:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191092.574773:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1892
00000100:00100000:2.0:1776191092.574779:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008ba1222e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613778624:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191092.574833:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bf7cf36f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613778496:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 75us (251us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191092.574843:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4294
00000100:00100000:2.0:1776191092.577993:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008ba1222e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613778624:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 3203us (3338us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191092.578020:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1892
00000100:00100000:2.0:1776191092.578075:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2130
00000100:00100000:2.0:1776191092.578081:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ee2fc84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613778688:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:2.0:1776191092.578186:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191092.578225:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ee2fc84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613778688:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 143us (3537us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191092.578233:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2130
00000100:00100000:2.0:1776191092.578403:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613778432
00000100:00100000:2.0:1776191092.578444:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1629
00000100:00100000:2.0:1776191092.578448:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e89cfd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613778432:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191092.578488:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e89cfd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613778432:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 38us (3964us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191092.578506:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1629
00000100:00100000:3.0:1776191092.580818:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4295
00000100:00100000:3.0:1776191092.580832:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc2bbe9c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613778560:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191092.580909:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc2bbe9c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613778560:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 79us (6295us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191092.580917:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4295
00010000:00010000:0.0:1776191092.731557:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191093.754312:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191094.010871:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191094.010888:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004f09a8ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630856000:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191094.010955:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191094.012310:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630856000
00000100:00100000:0.0:1776191094.012373:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2929
00000100:00100000:0.0:1776191094.012380:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dfe84e20 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630856000:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191094.012413:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191094.012542:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dfe84e20 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630856000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 161us (1586us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191094.012550:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2929
00000100:00100000:3.0:1776191094.012616:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004f09a8ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630856000:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191094.781024:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191095.034941:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776191095.034960:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008b75dd33 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630856064:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191095.035029:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191095.035182:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630856064
00000100:00100000:1.0:1776191095.035269:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2930
00000100:00100000:1.0:1776191095.035276:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d9f622e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630856064:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191095.035308:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191095.035363:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d9f622e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630856064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (335us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191095.035370:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2930
00000100:00100000:0.0:1776191095.035435:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008b75dd33 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630856064:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191095.802539:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1776191096.058407:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191096.058414:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191096.058417:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191096.058436:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3629
00000100:00080000:0.0:1776191096.058440:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191096.058445:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191096.058465:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000008a2b80b3 x1862467630856576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191096.058481:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191096.058483:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191096.058485:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191096.058487:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3629
00000100:00080000:0.0:1776191096.058489:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191096.058492:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191096.058502:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000055f4b7ff x1862467630856640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191096.058566:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e600ea8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630856256:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191096.058628:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191096.058655:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bed67ee8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630856512:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191096.058688:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191096.058712:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:0.0:1776191096.058718:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b08e6b10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630856320:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191096.058742:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191096.058755:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000a10d073 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630856704:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191096.058775:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191096.058796:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008a2b80b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630856576:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191096.058817:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191096.058829:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055f4b7ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630856640:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191096.058846:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191096.058879:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630856320
00000100:00100000:1.0:1776191096.059010:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048ee9cec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630856192:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191096.059055:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191096.059085:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fb519ed0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630856448:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191096.059106:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191096.059122:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [2->3]
00000100:00100000:1.0:1776191096.059127:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c7bea5f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630856128:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191096.059152:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191096.059167:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d0e4254d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630856384:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191096.059186:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191096.059200:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007bec6be8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630856768:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191096.059219:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191096.059245:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630856256
00000100:00100000:1.0:1776191096.059268:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630856384
00000100:00100000:1.0:1776191096.059284:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2931
00000100:00100000:1.0:1776191096.059289:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000087d9e22f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630856256:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191096.059337:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000087d9e22f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630856256:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (710us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191096.059344:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2931
00000100:00100000:1.0:1776191096.059360:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2932
00000100:00100000:1.0:1776191096.059364:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000012367763 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630856384:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191096.059394:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000012367763 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630856384:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (207us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191096.059400:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2932
00000100:00100000:1.0:1776191096.059431:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630856128
00000100:00100000:1.0:1776191096.059454:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1630
00000100:00100000:1.0:1776191096.059458:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f3625dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630856128:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191096.059484:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f3625dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630856128:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (332us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191096.059490:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1630
00000100:00100000:1.0:1776191096.059518:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630856704
00000100:00100000:1.0:1776191096.059539:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630856192
00000100:00100000:1.0:1776191096.059555:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630856768
00000100:00100000:1.0:1776191096.059570:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4296
00000100:00100000:1.0:1776191096.059573:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba5b492f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630856704:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191096.059600:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba5b492f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630856704:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (826us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191096.059606:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4296
00000100:00100000:1.0:1776191096.059614:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4297
00000100:00100000:1.0:1776191096.059617:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008b75dd33 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630856192:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191096.059639:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008b75dd33 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630856192:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (585us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191096.059644:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4297
00000100:00100000:1.0:1776191096.059654:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4298
00000100:00100000:1.0:1776191096.059657:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eb0e72b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630856768:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191096.059679:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eb0e72b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630856768:12345-0@lo:400:kworker/u8:2.0 Request processed in 20us (459us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191096.059683:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4298
00000100:00100000:1.0:1776191096.059717:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c7bea5f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630856128:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191096.059728:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0e4254d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630856384:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191096.059737:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007bec6be8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630856768:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191096.059745:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048ee9cec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630856192:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191096.059779:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000a10d073 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630856704:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191096.059787:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e600ea8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630856256:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191096.060126:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630856512
00000100:00100000:2.0:1776191096.060153:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630856576
00000100:00100000:2.0:1776191096.060166:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630856640
00000100:00100000:2.0:1776191096.060172:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630856448
00000100:00100000:2.0:1776191096.060183:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1893
00000100:00100000:2.0:1776191096.060187:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000040c4d502 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630856512:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191096.060226:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000040c4d502 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630856512:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (1538us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191096.060232:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1893
00000100:00100000:2.0:1776191096.060244:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1894
00000100:00100000:2.0:1776191096.060247:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bb77a7ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630856448:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191096.060276:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bb77a7ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630856448:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (1170us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191096.060281:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1894
00000100:00100000:2.0:1776191096.060291:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2131
00000100:00100000:2.0:1776191096.060294:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001648d249 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630856576:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191096.060385:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191096.060429:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001648d249 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630856576:12345-0@lo:8:kworker/u8:2.0 Request processed in 124us (1602us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191096.060436:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2131
00000100:00100000:2.0:1776191096.060447:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2132
00000100:00100000:2.0:1776191096.060450:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028c45c84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630856640:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191096.060532:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191096.060557:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028c45c84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630856640:12345-0@lo:8:kworker/u8:2.0 Request processed in 105us (1711us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191096.060563:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2132
00000100:00080000:2.0:1776191096.060608:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191096.060611:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191096.060614:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008a2b80b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630856576:0@lo:8:kworker/u8:2.0
00000100:00080000:2.0:1776191096.060621:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191096.060624:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191096.060626:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055f4b7ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630856640:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191096.060652:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bed67ee8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630856512:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191096.060673:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fb519ed0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630856448:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191096.060813:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4299
00000100:00100000:0.0:1776191096.060818:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b93c82 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630856320:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191096.060854:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b93c82 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630856320:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (2112us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191096.060859:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4299
00000100:00100000:3.0:1776191096.061096:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1776191096.061105:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000041c7ca25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630856832:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191096.061136:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191096.061167:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630856832
00000100:00100000:3.0:1776191096.061191:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1479
00000100:00100000:3.0:1776191096.061195:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a8f703ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630856832:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191096.061213:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191096.061244:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a8f703ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630856832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (108us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191096.061249:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1479
00000100:00100000:3.0:1776191096.061280:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000041c7ca25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630856832:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191096.062306:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc0a67c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630856896:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191096.062348:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191096.062386:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b08e6b10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630856320:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191096.062524:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630856896
00000100:00100000:1.0:1776191096.062560:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1480
00000100:00100000:1.0:1776191096.062565:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006165bc89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630856896:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191096.062581:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191096.062619:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006165bc89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630856896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (272us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191096.062626:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1480
00000100:00100000:1.0:1776191096.062654:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc0a67c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630856896:0@lo:13:osp-pre-0-0.0
00010000:00010000:3.0:1776191096.826253:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191097.694434:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191097.694485:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191097.694565:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191097.694599:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191097.694629:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191097.694691:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613778752
00000100:00100000:0.0:1776191097.694738:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1631
00000100:00100000:0.0:1776191097.694744:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e270043d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613778752:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191097.694815:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e270043d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613778752:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 69us (389us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191097.694823:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1631
00000100:00100000:0.0:1776191097.694958:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613778944
00000100:00100000:0.0:1776191097.694983:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613779008
00000100:00100000:0.0:1776191097.694998:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1895
00000100:00100000:0.0:1776191097.695003:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000042bf922a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613778944:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191097.695072:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000042bf922a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613778944:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 68us (508us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191097.695079:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1895
00000100:00100000:0.0:1776191097.695148:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2133
00000100:00100000:0.0:1776191097.695152:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dcce9244 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613779008:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:0.0:1776191097.695248:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191097.695277:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dcce9244 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613779008:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 123us (678us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191097.695283:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2133
00000100:00100000:3.0:1776191097.696811:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613778816
00000100:00100000:3.0:1776191097.696852:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613778880
00000100:00100000:1.0:1776191097.697177:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4300
00000100:00100000:1.0:1776191097.697183:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d7418614 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613778816:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191097.697248:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4301
00000100:00100000:1.0:1776191097.697253:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d7418614 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613778816:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 70us (2769us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191097.697253:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f09a8ca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613778880:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191097.697261:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4300
00000100:00100000:3.0:1776191097.697281:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f09a8ca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613778880:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 27us (2652us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191097.697286:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4301
00010000:00010000:0.0:1776191097.850314:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191098.876105:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191099.131963:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fe4d38b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630856960:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191099.132070:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191099.132255:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630856960
00000100:00100000:0.0:1776191099.132318:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2933
00000100:00100000:0.0:1776191099.132323:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000041c7ca25 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630856960:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191099.132363:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191099.132418:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000041c7ca25 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630856960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (349us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191099.132426:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2933
00000100:00100000:3.0:1776191099.132688:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fe4d38b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630856960:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191099.898472:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191100.154482:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191100.154505:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc0a67c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630857024:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191100.154575:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191100.154669:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630857024
00000100:00100000:1.0:1776191100.154721:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2934
00000100:00100000:1.0:1776191100.154727:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fadf7139 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630857024:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191100.154764:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191100.155001:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fadf7139 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630857024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 272us (426us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191100.155009:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2934
00000100:00100000:2.0:1776191100.155631:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc0a67c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630857024:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191100.922959:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191101.178336:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1776191101.178352:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006eae40ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630857088:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191101.178419:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191101.178758:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191101.178767:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc0a67c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630857152:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191101.178799:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191101.178830:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630857088
00000100:00100000:1.0:1776191101.178865:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630857152
00000100:00100000:1.0:1776191101.178883:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1481
00000100:00100000:1.0:1776191101.178889:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e2ce3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630857088:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191101.178918:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191101.179073:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1482
00000100:00100000:0.0:1776191101.179078:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b08e6b10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630857152:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191101.179091:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191101.179113:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e2ce3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630857088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 224us (694us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191101.179124:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b08e6b10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630857152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (325us total) trans 0 rc 0/0
00000100:00080000:3.0:1776191101.179214:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191101.179218:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191101.179221:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191101.179226:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3634
00000100:00080000:3.0:1776191101.179228:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191101.179233:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191101.179250:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000a63ab978 x1862467630857536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191101.179266:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191101.179269:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191101.179271:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191101.179273:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3634
00000100:00080000:3.0:1776191101.179275:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191101.179278:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191101.179287:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000bd153a77 x1862467630857600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191101.179344:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006644a6e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630857344:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191101.179373:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191101.179388:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ec90674 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630857728:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191101.179411:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191101.179429:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:3.0:1776191101.179434:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e486c123 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630857280:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191101.179453:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191101.179466:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e555734e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630857664:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191101.179482:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191101.179507:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630857728
00000100:00100000:3.0:1776191101.179530:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630857280
00000100:00100000:3.0:1776191101.179547:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630857664
00000100:00100000:3.0:1776191101.179579:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4302
00000100:00100000:3.0:1776191101.179584:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000da5c05bb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630857728:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191101.179618:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000da5c05bb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630857728:12345-0@lo:400:kworker/u8:4.0 Request processed in 34us (207us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191101.179628:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4302
00000100:00100000:3.0:1776191101.179644:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4303
00000100:00100000:3.0:1776191101.179648:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ede69d54 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630857280:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191101.179673:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ede69d54 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630857280:12345-0@lo:400:kworker/u8:4.0 Request processed in 24us (220us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191101.179678:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4303
00000100:00100000:3.0:1776191101.179688:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4304
00000100:00100000:3.0:1776191101.179691:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f74cc947 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630857664:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191101.179709:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f74cc947 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630857664:12345-0@lo:400:kworker/u8:4.0 Request processed in 18us (227us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191101.179715:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4304
00000100:00100000:3.0:1776191101.179750:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e486c123 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630857280:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191101.179760:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e555734e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630857664:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191101.179767:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ec90674 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630857728:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191101.179800:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a63ab978 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630857536:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191101.179824:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191101.179839:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd153a77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630857600:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191101.179860:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191101.179887:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630857536
00000100:00100000:3.0:1776191101.179906:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630857600
00000100:00100000:3.0:1776191101.179920:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2134
00000100:00100000:3.0:1776191101.179923:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ec90674 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630857536:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191101.180030:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191101.180082:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ec90674 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630857536:12345-0@lo:8:kworker/u8:4.0 Request processed in 158us (258us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191101.180089:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2134
00000100:00100000:3.0:1776191101.180100:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2135
00000100:00100000:3.0:1776191101.180103:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ac51952 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630857600:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191101.180184:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191101.180204:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ac51952 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630857600:12345-0@lo:8:kworker/u8:4.0 Request processed in 100us (345us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191101.180209:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2135
00000100:00080000:3.0:1776191101.180348:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191101.180352:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191101.180356:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a63ab978 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630857536:0@lo:8:kworker/u8:4.0
00000100:00080000:3.0:1776191101.180363:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191101.180365:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191101.180367:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd153a77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630857600:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191101.180420:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630857344
00000100:00100000:3.0:1776191101.180443:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2935
00000100:00100000:3.0:1776191101.180447:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e72cee95 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630857344:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191101.180480:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e72cee95 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630857344:12345-0@lo:400:kworker/u8:4.0 Request processed in 32us (1107us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191101.180486:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2935
00000100:00100000:3.0:1776191101.180503:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000016dc0009 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630857408:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191101.180525:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191101.180540:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:3.0:1776191101.180545:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006776e411 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630857216:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191101.180569:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191101.180583:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000263400d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630857472:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191101.180602:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191101.180622:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630857408
00000100:00100000:3.0:1776191101.180642:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4305
00000100:00100000:3.0:1776191101.180646:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bd153a77 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630857408:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191101.180676:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bd153a77 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630857408:12345-0@lo:400:kworker/u8:4.0 Request processed in 29us (151us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191101.180682:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4305
00000100:00100000:3.0:1776191101.180698:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630857472
00000100:00100000:3.0:1776191101.180715:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2936
00000100:00100000:3.0:1776191101.180718:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a63ab978 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630857472:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191101.180743:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a63ab978 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630857472:12345-0@lo:400:kworker/u8:4.0 Request processed in 24us (141us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191101.180749:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2936
00000100:00100000:3.0:1776191101.180770:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000263400d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630857472:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191101.180779:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000016dc0009 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630857408:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191101.180800:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006644a6e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630857344:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191101.180823:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630857216
00000100:00100000:3.0:1776191101.180843:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1632
00000100:00100000:3.0:1776191101.180846:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fecbd6f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630857216:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191101.180876:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fecbd6f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630857216:12345-0@lo:400:kworker/u8:4.0 Request processed in 29us (306us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191101.180881:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1632
00000100:00100000:3.0:1776191101.180906:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006776e411 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630857216:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191101.180959:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc0a67c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630857152:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191101.180989:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006eae40ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630857088:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191101.181890:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1481
00000100:00100000:0.0:1776191101.182055:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1482
00010000:00010000:0.0:1776191101.947321:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191102.811832:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191102.811892:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191102.811983:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613779136
00000100:00100000:2.0:1776191102.812083:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4306
00000100:00100000:2.0:1776191102.812098:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000673f0db9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613779136:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191102.812182:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000673f0db9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613779136:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 92us (290us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191102.812190:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4306
00000100:00100000:3.0:1776191102.812424:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613779072
00000100:00100000:3.0:1776191102.812459:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1633
00000100:00100000:3.0:1776191102.812465:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f7ed2aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613779072:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191102.812492:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191102.812504:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f7ed2aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613779072:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 38us (681us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191102.812512:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1633
00000100:00100000:1.0:1776191102.812542:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613779328
00000100:00100000:1.0:1776191102.812569:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2136
00000100:00100000:1.0:1776191102.812573:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb519ed0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613779328:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:1.0:1776191102.812670:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191102.812712:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb519ed0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613779328:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 138us (222us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191102.812720:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2136
00000100:00100000:3.0:1776191102.813166:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191102.813202:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191102.813286:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613779264
00000100:00100000:1.0:1776191102.813323:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1896
00000100:00100000:1.0:1776191102.813327:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006776e411 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613779264:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191102.813374:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006776e411 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613779264:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 46us (210us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191102.813381:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1896
00000100:00100000:0.0:1776191102.813395:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613779200
00000100:00100000:0.0:1776191102.813437:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4307
00000100:00100000:0.0:1776191102.813443:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006644a6e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613779200:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191102.813648:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006644a6e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613779200:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 204us (444us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191102.813655:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4307
00010000:00010000:3.0:1776191102.976282:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191103.996195:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191104.250288:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d48583e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630857792:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191104.250359:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191104.250537:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630857792
00000100:00100000:2.0:1776191104.250578:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2937
00000100:00100000:2.0:1776191104.250584:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016dc0009 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630857792:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191104.250615:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191104.250665:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016dc0009 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630857792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (307us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191104.250672:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2937
00000100:00100000:1.0:1776191104.250803:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d48583e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630857792:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191105.018265:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191105.274408:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bed67ee8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630857856:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191105.274486:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191105.274584:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630857856
00000100:00100000:1.0:1776191105.274632:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2938
00000100:00100000:1.0:1776191105.274638:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002200bdf2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630857856:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191105.274670:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191105.274712:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002200bdf2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630857856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (226us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191105.274720:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2938
00000100:00100000:2.0:1776191105.274798:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bed67ee8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630857856:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191106.042257:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191106.298236:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1776191106.298260:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1776191106.298260:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000263400d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630857920:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191106.298271:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023bc758a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630857984:0@lo:400:kworker/u8:2.0
00000100:00080000:0.0:1776191106.298315:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191106.298326:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191106.298330:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191106.298336:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3639
00000100:00080000:0.0:1776191106.298339:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00100000:2.0:1776191106.298346:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1776191106.298349:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191106.298349:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191106.298374:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000f055ad1b x1862467630858496/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191106.298393:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1776191106.298393:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000016f04c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630858240:0@lo:400:kworker/u8:2.0
00000100:00080000:0.0:1776191106.298399:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191106.298402:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191106.298407:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3639
00000100:00080000:0.0:1776191106.298410:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00100000:1.0:1776191106.298410:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630857984
00000100:00080000:0.0:1776191106.298415:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191106.298428:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191106.298429:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000009fbbc7a4 x1862467630858560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191106.298454:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e30dc2ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630858624:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191106.298461:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1634
00000100:00100000:2.0:1776191106.298464:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007bb93380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630858176:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191106.298471:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000328cc67f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630857984:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191106.298475:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630857920
00000100:00100000:3.0:1776191106.298486:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191106.298506:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191106.298526:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483
00000100:00100000:3.0:1776191106.298531:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f055ad1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630858496:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191106.298533:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ec90674 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630857920:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191106.298537:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055f4b7ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630858432:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191106.298542:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000328cc67f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630857984:12345-0@lo:400:kworker/u8:2.0 Request processed in 70us (198us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191106.298552:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1634
00002000:00000024:0.0:1776191106.298574:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191106.298576:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191106.298577:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191106.298589:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003664b2f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630858048:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191106.298605:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009fbbc7a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630858560:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191106.298620:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023bc758a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630857984:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191106.298639:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ec90674 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630857920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (294us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191106.298643:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191106.298649:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191106.298657:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000102502dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630858112:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191106.298675:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1e9431d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630858304:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191106.298689:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191106.298694:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630858624
00000100:00100000:1.0:1776191106.298705:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191106.298712:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000115a47cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630858368:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191106.298729:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be5463b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630858688:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191106.298730:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630858176
00000100:00100000:2.0:1776191106.298739:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191106.298758:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630858048
00000100:00100000:1.0:1776191106.298764:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191106.298781:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630858496
00000100:00100000:3.0:1776191106.298791:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630858688
00000100:00100000:2.0:1776191106.298810:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630858560
00000100:00100000:1.0:1776191106.298815:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630858432
00000100:00100000:3.0:1776191106.298816:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4308
00000100:00100000:3.0:1776191106.298823:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e486c123 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630858624:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191106.298833:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630858304
00000100:00100000:2.0:1776191106.298851:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630858368
00000100:00100000:3.0:1776191106.298867:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e486c123 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630858624:12345-0@lo:400:kworker/u8:2.0 Request processed in 42us (380us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191106.298868:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1897
00000100:00100000:2.0:1776191106.298875:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e600ea8b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630858304:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191106.298879:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4308
00000100:00100000:2.0:1776191106.298915:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e600ea8b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630858304:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (212us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191106.298922:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1897
00000100:00100000:2.0:1776191106.298934:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1898
00000100:00100000:2.0:1776191106.298937:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe4d38b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3364:x1862467630858368:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191106.299081:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe4d38b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3364:x1862467630858368:12345-0@lo:400:kworker/u8:2.0 Request processed in 142us (343us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191106.299089:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1898
00000100:00100000:2.0:1776191106.299101:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2137
00000100:00100000:2.0:1776191106.299104:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8a67d69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630858496:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191106.299194:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191106.299276:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8a67d69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630858496:12345-0@lo:8:kworker/u8:2.0 Request processed in 170us (704us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191106.299279:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4309
00000100:00100000:2.0:1776191106.299291:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2137
00000100:00100000:3.0:1776191106.299291:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d48583e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630858176:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191106.299307:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2138
00000100:00100000:2.0:1776191106.299312:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d4e3b26a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630858560:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191106.299337:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d48583e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630858176:12345-0@lo:400:kworker/u8:2.0 Request processed in 49us (832us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191106.299345:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4309
00000100:00100000:3.0:1776191106.299358:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4310
00000100:00100000:3.0:1776191106.299361:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a2b80b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630858048:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191106.299389:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a2b80b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630858048:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (754us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191106.299395:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4310
00000100:00100000:3.0:1776191106.299405:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4311
00000100:00100000:3.0:1776191106.299409:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000a10d073 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630858688:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191106.299433:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000a10d073 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630858688:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (672us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191106.299439:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4311
00010000:02020000:2.0:1776191106.299464:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1776191106.299476:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191106.299481:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191106.299485:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f055ad1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630858496:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191106.299496:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d4e3b26a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630858560:12345-0@lo:8:kworker/u8:2.0 Request processed in 181us (850us total) trans 0 rc -19/-19
00000100:00080000:3.0:1776191106.299499:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191106.299503:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191106.299504:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2138
00000100:00100000:3.0:1776191106.299509:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009fbbc7a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630858560:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191106.299534:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630858240
00000100:00100000:3.0:1776191106.299560:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003664b2f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630858048:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191106.299563:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630858112
00000100:00100000:3.0:1776191106.299574:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1e9431d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630858304:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191106.299580:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2939
00000100:00100000:2.0:1776191106.299586:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e555734e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630858240:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191106.299586:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be5463b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630858688:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191106.299623:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e555734e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630858240:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (1197us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191106.299631:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2939
00000100:00100000:3.0:1776191106.299644:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000115a47cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630858368:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191106.299647:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2940
00000100:00100000:2.0:1776191106.299653:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b7fdcd77 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630858112:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191106.299672:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007bb93380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630858176:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191106.299695:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b7fdcd77 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630858112:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (1008us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191106.299702:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2940
00000100:00100000:3.0:1776191106.299720:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000102502dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630858112:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191106.299790:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e30dc2ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630858624:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191106.299801:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000016f04c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630858240:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191106.299814:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000263400d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630857920:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191106.300588:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483
00000100:00100000:1.0:1776191106.301072:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1484
00000100:00100000:1.0:1776191106.301169:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005da74066 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630858432:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191106.301196:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191106.301274:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005da74066 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630858432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 195us (2701us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191106.301281:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1484
00000100:00100000:3.0:1776191106.301417:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055f4b7ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630858432:0@lo:13:osp-pre-0-0.0
00010000:00010000:0.0:1776191107.066709:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191107.933590:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191107.933643:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191107.933729:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191107.933749:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191107.933775:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191107.933806:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613779520
00000100:00100000:2.0:1776191107.933848:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613779456
00000100:00100000:2.0:1776191107.933867:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4312
00000100:00100000:2.0:1776191107.933874:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002116724a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613779520:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191107.934204:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613779648
00000100:00100000:3.0:1776191107.934229:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613779584
00000100:00100000:3.0:1776191107.934251:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1899
00000100:00100000:3.0:1776191107.934255:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2a7dce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613779584:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191107.934313:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2a7dce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613779584:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 56us (538us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191107.934320:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1899
00000100:00100000:3.0:1776191107.934336:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2139
00000100:00100000:3.0:1776191107.934340:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a27cd066 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613779648:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:3.0:1776191107.934428:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191107.934455:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a27cd066 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613779648:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 114us (873us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191107.934461:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2139
00000100:00100000:3.0:1776191107.934483:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4313
00000100:00100000:3.0:1776191107.934488:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c6da23c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613779456:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191107.934513:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c6da23c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613779456:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 24us (764us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191107.934518:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4313
00000100:00100000:2.0:1776191107.936567:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002116724a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613779520:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 2687us (2832us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191107.936583:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4312
00000100:00100000:1.0:1776191107.938101:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613779392
00000100:00100000:1.0:1776191107.938171:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1635
00000100:00100000:1.0:1776191107.938178:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019aa1469 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613779392:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191107.938250:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019aa1469 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613779392:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 71us (4606us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191107.938256:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1635
00010000:00010000:0.0:1776191108.092425:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191109.115185:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191109.373836:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191109.373858:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008ba1222e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630858752:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191109.373929:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191109.374020:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630858752
00000100:00100000:2.0:1776191109.374105:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2941
00000100:00100000:2.0:1776191109.374112:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048ee9cec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630858752:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191109.374152:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191109.374202:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048ee9cec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630858752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (273us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191109.374208:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2941
00000100:00100000:1.0:1776191109.374285:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008ba1222e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630858752:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191110.140257:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191110.394543:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d0e4254d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630858816:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191110.394612:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191110.394682:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630858816
00000100:00100000:0.0:1776191110.394738:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2942
00000100:00100000:0.0:1776191110.394744:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000950cd033 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630858816:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191110.394777:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191110.394827:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000950cd033 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630858816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (215us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191110.394833:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2942
00000100:00100000:3.0:1776191110.394871:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0e4254d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630858816:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191111.162261:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191111.419648:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c7bea5f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630858880:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191111.419697:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191111.419709:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000263400d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630858944:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191111.419723:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191111.419803:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630858880
00000100:00100000:1.0:1776191111.419849:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1485
00000100:00100000:1.0:1776191111.419856:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008ba1222e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630858880:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191111.419892:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00080000:0.0:1776191111.419909:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191111.419914:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191111.419918:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191111.419923:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3644
00000100:00080000:0.0:1776191111.419926:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191111.419931:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191111.419951:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000016f04c4f x1862467630859392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191111.419965:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191111.419968:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191111.419970:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191111.419972:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3644
00000100:00080000:0.0:1776191111.419974:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191111.419977:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191111.419985:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000e30dc2ee x1862467630859456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191111.420029:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000108d0e5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630859072:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191111.421986:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191111.422076:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000552b8f18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630859008:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191111.422141:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191111.422175:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048199cde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630859264:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191111.422202:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191111.422243:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:3.0:1776191111.422249:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003bea0498 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630859200:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191111.422273:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191111.422290:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007bb93380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630859584:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191111.422312:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191111.422344:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000016f04c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630859392:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191111.422369:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191111.422384:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e30dc2ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630859456:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191111.422405:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191111.422440:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630858944
00000100:00100000:3.0:1776191111.422479:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1486
00000100:00100000:3.0:1776191111.422484:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af393e55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630858944:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191111.422510:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191111.422551:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af393e55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630858944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (572us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191111.422558:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1486
00000100:00100000:3.0:1776191111.422582:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630859264
00000100:00100000:3.0:1776191111.422605:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2943
00000100:00100000:3.0:1776191111.422608:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028951562 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630859264:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191111.422637:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028951562 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630859264:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (435us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191111.422643:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2943
00000100:00100000:3.0:1776191111.422662:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630859392
00000100:00100000:3.0:1776191111.422676:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630859456
00000100:00100000:3.0:1776191111.422688:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2140
00000100:00100000:3.0:1776191111.422691:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad386bcf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630859392:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191111.422783:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191111.422816:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad386bcf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630859392:12345-0@lo:8:kworker/u8:2.0 Request processed in 124us (447us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191111.422825:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2140
00000100:00100000:3.0:1776191111.422835:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2141
00000100:00100000:3.0:1776191111.422839:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006eae40ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630859456:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191111.422922:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191111.422944:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006eae40ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630859456:12345-0@lo:8:kworker/u8:2.0 Request processed in 105us (540us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191111.422950:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2141
00000100:00100000:3.0:1776191111.422987:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048199cde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630859264:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191111.423003:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000263400d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630858944:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1776191111.423068:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191111.423072:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191111.423076:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000016f04c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630859392:0@lo:8:kworker/u8:2.0
00000100:00080000:3.0:1776191111.423083:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191111.423085:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191111.423101:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e30dc2ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630859456:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191111.423127:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630859200
00000100:00100000:3.0:1776191111.423151:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630859584
00000100:00100000:3.0:1776191111.423167:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4314
00000100:00100000:3.0:1776191111.423170:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000640b7818 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630859200:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191111.423207:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000640b7818 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630859200:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (933us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191111.423213:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4314
00000100:00100000:3.0:1776191111.423224:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4315
00000100:00100000:3.0:1776191111.423228:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cf2c1df6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630859584:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191111.423253:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cf2c1df6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630859584:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (941us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191111.423258:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4315
00000100:00100000:3.0:1776191111.423292:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003bea0498 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630859200:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191111.423302:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007bb93380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630859584:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191111.423345:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630859008
00000100:00100000:3.0:1776191111.423369:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1636
00000100:00100000:3.0:1776191111.423374:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe981ad6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630859008:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191111.423406:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe981ad6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630859008:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (1265us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191111.423411:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1636
00000100:00100000:3.0:1776191111.423441:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000552b8f18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630859008:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191111.425333:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014a5e911 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630859136:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191111.425395:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191111.425429:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000102502dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630859520:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191111.425455:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191111.425524:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630859520
00000100:00100000:2.0:1776191111.425576:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4316
00000100:00100000:2.0:1776191111.425582:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bb77a7ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630859520:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191111.425626:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bb77a7ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630859520:12345-0@lo:400:kworker/u8:2.0 Request processed in 44us (171us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191111.425633:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4316
00000100:00100000:2.0:1776191111.425673:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000102502dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630859520:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191111.426109:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630859136
00000100:00100000:3.0:1776191111.426135:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2944
00000100:00100000:3.0:1776191111.426140:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a0236b56 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630859136:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191111.426191:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a0236b56 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630859136:12345-0@lo:400:kworker/u8:2.0 Request processed in 51us (798us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191111.426197:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2944
00000100:00100000:2.0:1776191111.426523:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014a5e911 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630859136:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191111.427415:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008ba1222e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630858880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7556us (7690us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191111.427428:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1485
00000100:00100000:2.0:1776191111.427672:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c7bea5f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630858880:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191111.429357:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191111.429460:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba29c9bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630859328:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191111.429516:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191111.429583:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630859328
00000100:00100000:1.0:1776191111.429637:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1900
00000100:00100000:1.0:1776191111.429642:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be5463b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630859328:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191111.429699:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be5463b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630859328:12345-0@lo:400:kworker/u8:2.0 Request processed in 56us (183us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191111.429706:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1900
00000100:00100000:3.0:1776191111.430414:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630859072
00000100:00100000:3.0:1776191111.430502:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4317
00000100:00100000:3.0:1776191111.430508:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000115a47cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630859072:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191111.430553:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000115a47cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630859072:12345-0@lo:400:kworker/u8:2.0 Request processed in 45us (1201us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191111.430564:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4317
00000100:00100000:0.0:1776191111.430777:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000108d0e5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630859072:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191111.430789:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba29c9bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630859328:0@lo:400:kworker/u8:2.0
00010000:00010000:3.0:1776191112.186266:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191113.050852:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191113.050947:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191113.050984:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191113.051020:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191113.051088:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613779904
00000100:00100000:1.0:1776191113.051147:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1901
00000100:00100000:1.0:1776191113.051154:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000263400d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613779904:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191113.051219:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000263400d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613779904:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 64us (272us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191113.051225:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1901
00000100:00100000:0.0:1776191113.051532:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613779712
00000100:00100000:0.0:1776191113.051570:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1637
00000100:00100000:0.0:1776191113.051575:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001479089e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613779712:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191113.051608:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001479089e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613779712:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 33us (624us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191113.051618:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1637
00000100:00100000:3.0:1776191113.052614:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191113.052687:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613779968
00000100:00100000:1.0:1776191113.052721:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2142
00000100:00100000:1.0:1776191113.052726:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c904ec5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613779968:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:1.0:1776191113.052824:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191113.052869:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c904ec5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613779968:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 142us (260us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191113.052877:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2142
00000100:00100000:2.0:1776191113.053871:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613779776
00000100:00100000:2.0:1776191113.053920:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613779840
00000100:00100000:2.0:1776191113.054003:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4318
00000100:00100000:2.0:1776191113.054008:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc0a67c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613779776:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191113.054095:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc0a67c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613779776:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 86us (3251us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191113.054103:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4318
00000100:00100000:2.0:1776191113.054130:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4319
00000100:00100000:2.0:1776191113.054135:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c243e42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613779840:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191113.054159:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c243e42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613779840:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 24us (3139us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191113.054165:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4319
00010000:00010000:0.0:1776191113.210411:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191114.234680:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191114.490368:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076ea9d35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630859648:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191114.490439:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191114.490516:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630859648
00000100:00100000:0.0:1776191114.490576:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2945
00000100:00100000:0.0:1776191114.490581:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000055aaefe0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630859648:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191114.490614:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191114.491791:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000055aaefe0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630859648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1206us (1350us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191114.491801:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2945
00000100:00100000:3.0:1776191114.491889:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076ea9d35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630859648:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191115.258274:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191115.514857:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c7bea5f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630859712:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191115.514927:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191115.515063:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630859712
00000100:00100000:0.0:1776191115.515111:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2946
00000100:00100000:0.0:1776191115.515116:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ee2fc84 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630859712:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191115.515149:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191115.515212:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ee2fc84 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630859712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (284us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191115.515219:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2946
00000100:00100000:2.0:1776191115.515373:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c7bea5f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630859712:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191116.282380:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191116.538219:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000042bf922a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630859776:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191116.538446:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191116.538655:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630859776
00000100:00100000:3.0:1776191116.538701:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487
00000100:00100000:1.0:1776191116.538702:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191116.538709:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000076ea9d35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630859776:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191116.538715:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d0e4254d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630859840:0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191116.538745:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191116.538751:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191116.538784:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630859840
00000100:00100000:3.0:1776191116.538795:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000076ea9d35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630859776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (351us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191116.538804:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1487
00000100:00100000:1.0:1776191116.538816:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1488
00000100:00100000:1.0:1776191116.538822:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000055f4b7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630859840:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191116.538834:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191116.538866:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000055f4b7ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630859840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (118us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191116.538871:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1488
00000100:00100000:3.0:1776191116.539083:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0e4254d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630859840:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191116.539095:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000042bf922a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630859776:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1776191116.539415:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191116.539420:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191116.539424:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191116.539429:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3649
00000100:00080000:1.0:1776191116.539431:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191116.539435:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191116.539454:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000f97d550a x1862467630860224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191116.539474:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191116.539477:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191116.539479:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191116.539482:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3649
00000100:00080000:1.0:1776191116.539483:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191116.539486:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191116.539496:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000155ae841 x1862467630860288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191116.539540:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f97d550a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630860224:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191116.539574:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191116.539593:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000155ae841 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630860288:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191116.539614:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191116.539641:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630860224
00000100:00100000:1.0:1776191116.539662:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630860288
00000100:00100000:1.0:1776191116.539678:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2143
00000100:00100000:1.0:1776191116.539682:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ecd900ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630860224:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191116.539775:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191116.539809:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ecd900ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630860224:12345-0@lo:8:kworker/u8:4.0 Request processed in 126us (235us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191116.539815:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2143
00000100:00100000:1.0:1776191116.539827:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2144
00000100:00100000:1.0:1776191116.539830:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b92c4097 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630860288:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191116.539911:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191116.539934:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b92c4097 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630860288:12345-0@lo:8:kworker/u8:4.0 Request processed in 103us (320us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191116.539940:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2144
00000100:00080000:1.0:1776191116.539969:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191116.539972:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191116.539988:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f97d550a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630860224:0@lo:8:kworker/u8:4.0
00000100:00080000:1.0:1776191116.539998:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191116.540000:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191116.540003:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000155ae841 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630860288:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191116.540118:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eefb5d99 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630859968:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191116.540151:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191116.540185:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d0e4254d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630860352:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191116.540204:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191116.540225:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:0.0:1776191116.540229:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014441fbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630860032:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191116.540252:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191116.540435:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630860032
00000100:00100000:0.0:1776191116.540465:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2947
00000100:00100000:0.0:1776191116.540470:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a1e9431d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630860032:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191116.540504:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a1e9431d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630860032:12345-0@lo:400:kworker/u8:4.0 Request processed in 34us (252us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191116.540510:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2947
00000100:00100000:0.0:1776191116.540532:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630859968
00000100:00100000:0.0:1776191116.540551:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630860352
00000100:00100000:0.0:1776191116.540570:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4320
00000100:00100000:0.0:1776191116.540573:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba29c9bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630859968:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191116.540598:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba29c9bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630859968:12345-0@lo:400:kworker/u8:4.0 Request processed in 24us (447us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191116.540603:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4320
00000100:00100000:0.0:1776191116.540613:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4321
00000100:00100000:0.0:1776191116.540616:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000108d0e5b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630860352:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191116.540636:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000108d0e5b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630860352:12345-0@lo:400:kworker/u8:4.0 Request processed in 19us (431us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191116.540640:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4321
00000100:00100000:0.0:1776191116.540658:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c7bea5f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630860416:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191116.540678:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191116.540694:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630860416
00000100:00100000:0.0:1776191116.540716:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4322
00000100:00100000:0.0:1776191116.540719:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003664b2f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630860416:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191116.540747:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003664b2f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630860416:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (69us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191116.540753:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4322
00000100:00100000:0.0:1776191116.540778:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eefb5d99 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630859968:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191116.540787:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0e4254d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630860352:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191116.540805:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014441fbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630860032:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191116.540813:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c7bea5f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630860416:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191116.540997:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006605fbf0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630860096:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191116.541029:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191116.541082:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:2.0:1776191116.541088:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bed67ee8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630859904:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191116.541115:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191116.541132:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000caebeb11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630860160:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191116.541153:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191116.541376:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630859904
00000100:00100000:2.0:1776191116.541404:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1638
00000100:00100000:2.0:1776191116.541408:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fc1666bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630859904:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191116.541445:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fc1666bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630859904:12345-0@lo:400:kworker/u8:4.0 Request processed in 35us (329us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191116.541451:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1638
00000100:00100000:2.0:1776191116.541486:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bed67ee8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630859904:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191116.541624:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630860160
00000100:00100000:1.0:1776191116.541814:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630860096
00000100:00100000:1.0:1776191116.541852:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4323
00000100:00100000:1.0:1776191116.541857:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008169e6c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630860096:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191116.541900:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008169e6c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630860096:12345-0@lo:400:kworker/u8:4.0 Request processed in 42us (870us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191116.541906:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4323
00000100:00100000:0.0:1776191116.541974:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2948
00000100:00100000:0.0:1776191116.541989:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000c128c04 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630860160:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191116.542022:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000c128c04 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630860160:12345-0@lo:400:kworker/u8:4.0 Request processed in 34us (869us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191116.542028:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2948
00000100:00100000:2.0:1776191116.542128:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000caebeb11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630860160:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191116.542141:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006605fbf0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630860096:0@lo:400:kworker/u8:4.0
00010000:00010000:0.0:1776191117.307666:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191118.171306:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191118.171356:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191118.171399:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191118.171638:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613780288
00000100:00100000:2.0:1776191118.171688:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2145
00000100:00100000:2.0:1776191118.171696:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dcce9244 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613780288:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:2.0:1776191118.171806:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191118.171897:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dcce9244 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613780288:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 200us (540us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191118.171911:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2145
00000100:00100000:1.0:1776191118.172432:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613780160
00000100:00100000:1.0:1776191118.172476:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4324
00000100:00100000:1.0:1776191118.172480:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000042bf922a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613780160:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191118.172535:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000042bf922a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613780160:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 53us (1136us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191118.172542:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4324
00000100:00100000:1.0:1776191118.172566:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613780032
00000100:00100000:1.0:1776191118.172598:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1639
00000100:00100000:1.0:1776191118.172602:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000280cef61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613780032:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191118.172629:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000280cef61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613780032:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 25us (1332us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191118.172635:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1639
00000100:00100000:3.0:1776191118.180846:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191118.181592:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613780096
00000100:00100000:2.0:1776191118.181699:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4325
00000100:00100000:2.0:1776191118.181706:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070835139 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613780096:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191118.181727:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191118.181787:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070835139 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613780096:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 80us (948us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191118.181795:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4325
00000100:00100000:3.0:1776191118.181853:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613780224
00000100:00100000:3.0:1776191118.181889:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1902
00000100:00100000:3.0:1776191118.181895:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009fbbc7a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613780224:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191118.181937:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009fbbc7a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613780224:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 40us (211us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191118.181953:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1902
00010000:00010000:3.0:1776191118.334786:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191119.354264:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191119.610322:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191119.610345:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ca7e4d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630860480:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191119.610418:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191119.610525:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630860480
00000100:00100000:2.0:1776191119.610577:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2949
00000100:00100000:2.0:1776191119.610582:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006605fbf0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630860480:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191119.610613:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191119.610674:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006605fbf0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630860480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (258us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191119.610680:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2949
00000100:00100000:1.0:1776191119.610762:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ca7e4d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630860480:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191120.384756:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191120.634772:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776191120.634789:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000caebeb11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630860544:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191120.634854:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191120.634950:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630860544
00000100:00100000:0.0:1776191120.634996:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2950
00000100:00100000:0.0:1776191120.635001:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007582ba84 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630860544:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191120.635051:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191120.635108:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007582ba84 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630860544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (254us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191120.635115:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2950
00000100:00100000:1.0:1776191120.635327:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000caebeb11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630860544:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191121.404909:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191121.658662:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000caebeb11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630860608:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191121.658732:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191121.658779:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ab7db222 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630860864:0@lo:400:kworker/u8:4.0
00000100:00080000:3.0:1776191121.658807:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1776191121.658813:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1776191121.658816:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191121.658821:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191121.658827:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3654
00000100:00080000:3.0:1776191121.658830:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191121.658835:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191121.658885:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630860608
00000100:00100000:1.0:1776191121.658936:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1489
00000100:00100000:1.0:1776191121.658942:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f055ad1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630860608:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191121.658984:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191121.659161:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000150035b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630860672:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191121.659197:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191121.659215:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093a782ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630860928:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191121.659238:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191121.659774:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000006821defb x1862467630861056/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191121.659794:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1776191121.659797:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000caebeb11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630860608:0@lo:13:osp-pre-0-0.0
00000100:00080000:3.0:1776191121.659799:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191121.659802:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191121.659808:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3654
00000100:00080000:3.0:1776191121.659810:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191121.659814:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191121.659826:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000005f9ce4ac x1862467630861120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191121.659863:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005be56c88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630860736:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191121.659883:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000939787e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630860800:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191121.659919:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191121.659927:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191121.659939:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ff6c3c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630860992:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191121.659951:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001dcb8edb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630861184:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191121.659967:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191121.659985:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191121.660013:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006821defb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630861056:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191121.660028:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630860928
00000100:00100000:0.0:1776191121.660068:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191121.660084:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005f9ce4ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630861120:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191121.660104:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191121.660131:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630860672
00000100:00100000:3.0:1776191121.660154:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630860800
00000100:00100000:3.0:1776191121.660176:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2951
00000100:00100000:3.0:1776191121.660180:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001ca7e4d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630860928:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191121.660185:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1640
00000100:00100000:0.0:1776191121.660192:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ea296a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630860672:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191121.660230:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001ca7e4d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630860928:12345-0@lo:400:kworker/u8:4.0 Request processed in 49us (991us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191121.660241:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2951
00000100:00100000:0.0:1776191121.660242:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ea296a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630860672:12345-0@lo:400:kworker/u8:4.0 Request processed in 47us (1041us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191121.660252:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1640
00000100:00100000:3.0:1776191121.660262:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2952
00000100:00100000:3.0:1776191121.660268:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001f598cfd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630860800:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191121.660290:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630860992
00000100:00100000:3.0:1776191121.660304:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001f598cfd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630860800:12345-0@lo:400:kworker/u8:4.0 Request processed in 34us (377us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191121.660310:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2952
00000100:00100000:0.0:1776191121.660320:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630861056
00000100:00100000:0.0:1776191121.660337:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630861120
00000100:00100000:3.0:1776191121.660627:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1903
00000100:00100000:3.0:1776191121.660633:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001648d249 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630860992:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191121.660671:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001648d249 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630860992:12345-0@lo:400:kworker/u8:4.0 Request processed in 37us (704us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191121.660677:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1903
00000100:00100000:3.0:1776191121.660690:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2146
00000100:00100000:3.0:1776191121.660693:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028c45c84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630861056:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191121.660784:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191121.660815:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028c45c84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630861056:12345-0@lo:8:kworker/u8:4.0 Request processed in 120us (748us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191121.660821:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2146
00000100:00100000:3.0:1776191121.660831:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2147
00000100:00100000:3.0:1776191121.660834:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007bec6be8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630861120:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191121.660925:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191121.660949:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007bec6be8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630861120:12345-0@lo:8:kworker/u8:4.0 Request processed in 114us (845us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191121.660955:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2147
00000100:00100000:3.0:1776191121.660976:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630860864
00000100:00100000:3.0:1776191121.661001:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630860736
00000100:00100000:3.0:1776191121.661015:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630861184
00000100:00100000:3.0:1776191121.661030:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4326
00000100:00100000:3.0:1776191121.661050:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000023bc758a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630860864:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191121.661093:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000023bc758a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630860864:12345-0@lo:400:kworker/u8:4.0 Request processed in 43us (2283us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191121.661100:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4326
00000100:00100000:3.0:1776191121.661112:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4327
00000100:00100000:3.0:1776191121.661115:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000040c4d502 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630860736:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191121.661152:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000040c4d502 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630860736:12345-0@lo:400:kworker/u8:4.0 Request processed in 36us (1234us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191121.661157:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4327
00000100:00100000:3.0:1776191121.661167:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4328
00000100:00100000:3.0:1776191121.661170:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000290b34e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630861184:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191121.661195:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000290b34e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630861184:12345-0@lo:400:kworker/u8:4.0 Request processed in 24us (1213us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191121.661200:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4328
00000100:00080000:3.0:1776191121.661246:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191121.661249:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191121.661254:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006821defb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630861056:0@lo:8:kworker/u8:4.0
00000100:00080000:3.0:1776191121.661263:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191121.661266:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191121.661269:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005f9ce4ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630861120:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191121.661305:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005be56c88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630860736:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191121.661315:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ff6c3c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630860992:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191121.661339:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000939787e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630860800:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191121.661348:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001dcb8edb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630861184:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191121.661370:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd341e03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630861248:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191121.661472:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f055ad1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630860608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (338us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191121.661481:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1489
00000100:00100000:2.0:1776191121.661893:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bed67ee8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630861312:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191121.661933:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191121.661957:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000150035b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630860672:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191121.661967:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093a782ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630860928:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191121.664641:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630861312
00000100:00100000:1.0:1776191121.664699:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1490
00000100:00100000:1.0:1776191121.664706:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f6f66ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630861312:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191121.664733:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191121.664805:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f6f66ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630861312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (2871us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191121.664812:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1490
00000100:00100000:1.0:1776191121.664897:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bed67ee8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630861312:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191121.665320:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191121.665347:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ab7db222 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630860864:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191121.665921:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630861248
00000100:00100000:1.0:1776191121.665962:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4329
00000100:00100000:1.0:1776191121.665967:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001dcb8edb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630861248:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191121.666020:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001dcb8edb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630861248:12345-0@lo:400:kworker/u8:4.0 Request processed in 52us (701us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191121.666027:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4329
00000100:00100000:3.0:1776191121.666198:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd341e03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630861248:0@lo:400:kworker/u8:4.0
00010000:00010000:0.0:1776191122.426958:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191123.290222:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191123.290513:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613780608
00000100:00100000:1.0:1776191123.290568:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2148
00000100:00100000:1.0:1776191123.290576:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd341e03 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613780608:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00000100:00100000:0.0:1776191123.290652:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191123.290688:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00010000:02020000:1.0:1776191123.290702:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191123.290718:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191123.290782:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd341e03 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613780608:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 205us (566us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191123.290791:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2148
00000100:00100000:0.0:1776191123.290798:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191123.290811:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613780544
00000100:00100000:1.0:1776191123.290870:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1904
00000100:00100000:1.0:1776191123.290876:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000102502dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613780544:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191123.290921:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000102502dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613780544:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 43us (232us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191123.290928:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1904
00000100:00100000:3.0:1776191123.291003:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613780416
00000100:00100000:3.0:1776191123.291070:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613780480
00000100:00100000:2.0:1776191123.291089:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4330
00000100:00100000:2.0:1776191123.291095:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000014a5e911 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613780416:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191123.291108:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4331
00000100:00100000:3.0:1776191123.291114:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000552b8f18 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613780480:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191123.291138:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000014a5e911 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613780416:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 41us (487us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191123.291147:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4330
00000100:00100000:3.0:1776191123.291165:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000552b8f18 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613780480:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 36us (355us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191123.291169:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613780352
00000100:00100000:3.0:1776191123.291174:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4331
00000100:00100000:2.0:1776191123.291198:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1641
00000100:00100000:2.0:1776191123.291204:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e58aa936 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613780352:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191123.291231:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e58aa936 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613780352:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 27us (514us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191123.291238:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1641
00010000:00010000:0.0:1776191123.450342:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191124.474300:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191124.733544:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ab7db222 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630861376:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191124.733622:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191124.733764:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630861376
00000100:00100000:1.0:1776191124.733824:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2953
00000100:00100000:1.0:1776191124.733829:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000062cce429 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630861376:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191124.733857:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191124.735406:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000062cce429 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630861376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1571us (1780us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191124.735419:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2953
00000100:00100000:3.0:1776191124.735743:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ab7db222 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630861376:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191125.498945:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191125.754403:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776191125.754424:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ff26b50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630861440:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191125.754488:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191125.754579:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630861440
00000100:00100000:2.0:1776191125.754628:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2954
00000100:00100000:2.0:1776191125.754633:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007bb93380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630861440:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191125.754669:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191125.754715:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007bb93380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630861440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (228us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191125.754721:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2954
00000100:00100000:1.0:1776191125.755401:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ff26b50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630861440:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191126.523000:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191126.778160:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776191126.778183:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ff26b50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630861504:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191126.778254:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191126.778574:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630861504
00000100:00100000:0.0:1776191126.778626:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1491
00000100:00100000:0.0:1776191126.778632:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3653833 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630861504:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191126.778661:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191126.778714:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3653833 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630861504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (462us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191126.778722:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1491
00000100:00100000:1.0:1776191126.778773:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ff26b50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630861504:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191126.779442:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1776191126.779452:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093a782ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630861568:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191126.779487:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191126.779567:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630861568
00000100:00100000:1.0:1776191126.779602:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1492
00000100:00100000:1.0:1776191126.779607:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ff6c3c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630861568:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191126.779622:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191126.779663:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ff6c3c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630861568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (176us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191126.779669:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1492
00000100:00100000:2.0:1776191126.779987:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093a782ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630861568:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1776191126.780181:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191126.780186:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191126.780189:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191126.780193:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3659
00000100:00080000:0.0:1776191126.780196:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191126.780200:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191126.780219:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000fadf7139 x1862467630861952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191126.780233:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191126.780235:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191126.780237:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191126.780240:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3659
00000100:00080000:0.0:1776191126.780241:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191126.780244:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191126.780253:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000a1e9431d x1862467630862016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191126.780329:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003bea0498 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630861632:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191126.780365:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191126.780387:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087d9e22f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630861888:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191126.780410:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191126.780427:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:1.0:1776191126.780432:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e30dc2ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630861696:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191126.780455:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191126.780469:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000006c85329 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630862080:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191126.780487:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191126.780511:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630861696
00000100:00100000:1.0:1776191126.780533:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630862080
00000100:00100000:1.0:1776191126.780564:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4332
00000100:00100000:1.0:1776191126.780568:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000032a96b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630861696:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191126.780607:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000032a96b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630861696:12345-0@lo:400:kworker/u8:4.0 Request processed in 39us (151us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191126.780613:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4332
00000100:00100000:1.0:1776191126.780626:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4333
00000100:00100000:1.0:1776191126.780629:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d9f622e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630862080:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191126.780654:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d9f622e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630862080:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (166us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191126.780660:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4333
00000100:00100000:1.0:1776191126.780680:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630861888
00000100:00100000:1.0:1776191126.780700:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2955
00000100:00100000:1.0:1776191126.780704:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ff26b50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630861888:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191126.780742:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ff26b50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630861888:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (320us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191126.780750:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2955
00000100:00100000:1.0:1776191126.780783:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e30dc2ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630861696:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191126.780791:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000006c85329 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630862080:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191126.780798:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087d9e22f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630861888:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191126.781152:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fadf7139 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630861952:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191126.781182:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191126.781206:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1e9431d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630862016:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191126.781226:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191126.781258:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048199cde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630861824:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191126.781283:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191126.781299:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:3.0:1776191126.781304:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000016f04c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630861760:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191126.781326:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191126.781340:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dbd40b9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630862144:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191126.781358:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191126.781379:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630861824
00000100:00100000:3.0:1776191126.781401:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630862144
00000100:00100000:3.0:1776191126.781419:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4334
00000100:00100000:3.0:1776191126.781423:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004feb6fa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630861824:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191126.781452:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004feb6fa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630861824:12345-0@lo:400:kworker/u8:4.0 Request processed in 29us (169us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191126.781458:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4334
00000100:00100000:3.0:1776191126.781468:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4335
00000100:00100000:3.0:1776191126.781471:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f3989c1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630862144:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191126.781490:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f3989c1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630862144:12345-0@lo:400:kworker/u8:4.0 Request processed in 19us (132us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191126.781495:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4335
00000100:00100000:3.0:1776191126.781511:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630861760
00000100:00100000:3.0:1776191126.781526:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2956
00000100:00100000:3.0:1776191126.781530:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e8375317 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630861760:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191126.781565:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e8375317 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630861760:12345-0@lo:400:kworker/u8:4.0 Request processed in 35us (239us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191126.781570:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2956
00000100:00100000:3.0:1776191126.781599:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000016f04c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630861760:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191126.781607:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dbd40b9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630862144:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191126.781614:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048199cde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630861824:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191126.781908:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630861632
00000100:00100000:0.0:1776191126.781939:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1642
00000100:00100000:0.0:1776191126.781942:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae4705ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630861632:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191126.782126:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae4705ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630861632:12345-0@lo:400:kworker/u8:4.0 Request processed in 182us (1761us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191126.782133:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1642
00000100:00100000:1.0:1776191126.782245:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630861952
00000100:00100000:1.0:1776191126.782266:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630862016
00000100:00100000:1.0:1776191126.782287:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2149
00000100:00100000:1.0:1776191126.782291:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005f9ce4ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630861952:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191126.782383:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191126.782416:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005f9ce4ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630861952:12345-0@lo:8:kworker/u8:4.0 Request processed in 125us (1234us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191126.782422:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2149
00000100:00100000:1.0:1776191126.782433:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2150
00000100:00100000:1.0:1776191126.782436:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006821defb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630862016:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191126.782513:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191126.782536:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006821defb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630862016:12345-0@lo:8:kworker/u8:4.0 Request processed in 99us (1310us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191126.782701:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2150
00000100:00100000:3.0:1776191126.783142:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003bea0498 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630861632:0@lo:400:kworker/u8:4.0
00000100:00080000:3.0:1776191126.783177:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191126.783181:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191126.783185:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fadf7139 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630861952:0@lo:8:kworker/u8:4.0
00000100:00080000:3.0:1776191126.783194:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191126.783196:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191126.783198:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1e9431d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630862016:0@lo:8:kworker/u8:4.0
00010000:00010000:3.0:1776191127.546431:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191128.411162:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191128.411417:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191128.411462:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191128.411497:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191128.411549:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613780672
00000100:00100000:3.0:1776191128.411601:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1643
00000100:00100000:3.0:1776191128.411608:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000deab4b38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613780672:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191128.411681:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000deab4b38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613780672:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 72us (219us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191128.411689:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1643
00000100:00100000:2.0:1776191128.412229:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613780864
00000100:00100000:2.0:1776191128.412268:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1905
00000100:00100000:2.0:1776191128.412273:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dbd40b9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613780864:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191128.412310:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dbd40b9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613780864:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 36us (895us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191128.412317:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1905
00000100:00100000:0.0:1776191128.416131:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191128.416301:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613780736
00000100:00100000:2.0:1776191128.416402:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613780928
00000100:00100000:2.0:1776191128.416438:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2151
00000100:00100000:2.0:1776191128.416444:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002200bdf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613780928:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:2.0:1776191128.416555:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191128.416615:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002200bdf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613780928:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 169us (492us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191128.416622:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2151
00000100:00100000:3.0:1776191128.425970:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613780800
00000100:00100000:3.0:1776191128.426061:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4336
00000100:00100000:3.0:1776191128.426540:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001d2d29b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613780736:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191128.426627:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001d2d29b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613780736:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 90us (15473us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191128.426699:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4337
00000100:00100000:2.0:1776191128.426707:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000006c85329 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613780800:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191128.426752:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000006c85329 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613780800:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 44us (15254us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191128.426759:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4337
00000100:00100000:3.0:1776191128.426814:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4336
00010000:00010000:0.0:1776191128.571659:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191129.594541:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191129.850220:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093a782ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630862208:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191129.850291:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191129.850628:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630862208
00000100:00100000:2.0:1776191129.854482:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2957
00000100:00100000:2.0:1776191129.854500:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a25bb0a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630862208:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191129.854542:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191129.854635:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a25bb0a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630862208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (4345us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191129.854643:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2957
00000100:00100000:0.0:1776191129.854743:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093a782ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630862208:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191130.618508:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191130.874321:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1776191130.874337:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048ee9cec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630862272:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191130.874405:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191130.874495:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630862272
00000100:00100000:0.0:1776191130.874544:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2958
00000100:00100000:0.0:1776191130.874551:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093a782ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630862272:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191130.874585:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191130.874635:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093a782ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630862272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (231us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191130.874642:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2958
00000100:00100000:2.0:1776191130.874745:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048ee9cec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630862272:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191131.643524:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191131.898210:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191131.898230:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd36ba63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630862336:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191131.898302:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191131.898434:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630862336
00000100:00100000:2.0:1776191131.898483:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493
00000100:00100000:2.0:1776191131.898488:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008ef4d77e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630862336:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191131.898516:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191131.898557:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008ef4d77e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630862336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (255us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191131.898574:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493
00000100:00100000:2.0:1776191131.898659:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ab7db222 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630862400:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191131.898691:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191131.898698:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191131.898704:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191131.898707:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191131.898712:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3664
00000100:00100000:2.0:1776191131.898714:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014441fbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630862656:0@lo:400:kworker/u8:4.0
00000100:00080000:1.0:1776191131.898716:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191131.898723:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191131.898745:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000155ae841 x1862467630862848/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191131.898748:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191131.898762:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191131.898765:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191131.898767:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191131.898770:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3664
00000100:00080000:1.0:1776191131.898772:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191131.898774:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191131.898832:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c7bea5f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630862592:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191131.898861:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191131.898879:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:0.0:1776191131.898885:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bed67ee8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630862528:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191131.898905:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191131.898932:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eefb5d99 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630862784:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191131.898952:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191131.898975:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630862656
00000100:00100000:0.0:1776191131.899004:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630862528
00000100:00100000:0.0:1776191131.899020:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4338
00000100:00100000:0.0:1776191131.899024:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007756d7ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630862656:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191131.899075:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007756d7ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630862656:12345-0@lo:400:kworker/u8:4.0 Request processed in 49us (330us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191131.899081:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4338
00000100:00100000:0.0:1776191131.899093:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4339
00000100:00100000:0.0:1776191131.899096:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000012367763 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630862528:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191131.899122:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000012367763 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630862528:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (216us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191131.899127:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4339
00000100:00100000:0.0:1776191131.899148:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630862592
00000100:00100000:0.0:1776191131.899169:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2959
00000100:00100000:0.0:1776191131.899172:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b7fdcd77 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630862592:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191131.899210:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b7fdcd77 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630862592:12345-0@lo:400:kworker/u8:4.0 Request processed in 37us (349us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191131.899215:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2959
00000100:00100000:0.0:1776191131.899234:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630862784
00000100:00100000:0.0:1776191131.899256:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1906
00000100:00100000:0.0:1776191131.899260:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a0236b56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630862784:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191131.899288:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a0236b56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630862784:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (336us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191131.899293:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1906
00000100:00100000:0.0:1776191131.899335:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bed67ee8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630862528:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191131.899346:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eefb5d99 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630862784:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191131.899352:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c7bea5f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630862592:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191131.899380:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006605fbf0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630862464:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191131.899407:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191131.899421:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d0e4254d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630862720:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191131.899440:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191131.899466:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630862720
00000100:00100000:0.0:1776191131.899484:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2960
00000100:00100000:0.0:1776191131.899487:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b824a572 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630862720:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191131.899516:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b824a572 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630862720:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (76us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191131.899524:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2960
00000100:00100000:0.0:1776191131.899544:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0e4254d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630862720:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191131.899610:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630862400
00000100:00100000:0.0:1776191131.899629:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1494
00000100:00100000:0.0:1776191131.899633:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de9cc0f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630862400:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191131.899654:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191131.899723:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000155ae841 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630862848:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191131.899741:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014441fbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630862656:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191131.899755:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191131.899784:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630862464
00000100:00100000:1.0:1776191131.899807:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000f97d550a x1862467630862912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191131.899810:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1644
00000100:00100000:3.0:1776191131.899819:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a4afbcc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630862464:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191131.899852:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630862848
00000100:00100000:3.0:1776191131.899860:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a4afbcc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630862464:12345-0@lo:400:kworker/u8:4.0 Request processed in 41us (452us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191131.899866:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1644
00000100:00100000:2.0:1776191131.899877:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2152
00000100:00100000:2.0:1776191131.899882:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008deca8e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630862848:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191131.899904:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f97d550a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630862912:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191131.899926:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191131.899949:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630862912
00000100:00100000:3.0:1776191131.899966:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2153
00000100:00100000:3.0:1776191131.899969:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000421d4a36 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630862912:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191131.900057:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014441fbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630862976:0@lo:400:kworker/u8:4.0
00010000:02020000:3.0:1776191131.900072:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191131.900089:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191131.900115:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000421d4a36 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630862912:12345-0@lo:8:kworker/u8:4.0 Request processed in 143us (188us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191131.900122:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2153
00000100:00080000:3.0:1776191131.900151:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191131.900155:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191131.900158:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f97d550a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630862912:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191131.900167:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd36ba63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630862336:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191131.900191:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d0e4254d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630863040:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191131.900206:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006605fbf0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630862464:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191131.900219:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191131.900253:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630862976
00000100:00100000:3.0:1776191131.900283:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630863040
00000100:00100000:3.0:1776191131.900300:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4340
00000100:00100000:3.0:1776191131.900303:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c7bea5f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630862976:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191131.900336:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c7bea5f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630862976:12345-0@lo:400:kworker/u8:4.0 Request processed in 32us (249us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191131.900342:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4340
00000100:00100000:3.0:1776191131.900356:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4341
00000100:00100000:3.0:1776191131.900359:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d3569406 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630863040:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191131.900387:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d3569406 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630863040:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (170us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191131.900392:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4341
00000100:00100000:3.0:1776191131.900418:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014441fbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630862976:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191131.900437:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0e4254d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630863040:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191131.900703:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de9cc0f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630862400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1068us (2012us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191131.900710:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1494
00000100:00100000:3.0:1776191131.901080:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ab7db222 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630862400:0@lo:13:osp-pre-0-0.0
00010000:02020000:2.0:1776191131.901223:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191131.901270:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008deca8e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630862848:12345-0@lo:8:kworker/u8:4.0 Request processed in 1387us (1516us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191131.901278:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2152
00000100:00080000:3.0:1776191131.901410:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191131.901414:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191131.901417:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000155ae841 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630862848:0@lo:8:kworker/u8:4.0
00010000:00010000:0.0:1776191132.667638:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191133.532697:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191133.532749:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191133.532862:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613780992
00000100:00100000:1.0:1776191133.533059:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1645
00000100:00100000:1.0:1776191133.533066:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dbba1dca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613780992:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191133.533370:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613781056
00000100:00100000:3.0:1776191133.533405:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4342
00000100:00100000:3.0:1776191133.533409:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c634116b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613781056:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191133.535094:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c634116b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613781056:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 1676us (2339us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191133.535115:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4342
00000100:00100000:2.0:1776191133.537012:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191133.537203:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dbba1dca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613780992:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 4135us (5114us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191133.537219:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1645
00000100:00100000:2.0:1776191133.537632:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191133.537747:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613781184
00000100:00100000:1.0:1776191133.537801:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1907
00000100:00100000:1.0:1776191133.537808:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000041c7ca25 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613781184:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191133.537859:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000041c7ca25 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613781184:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 50us (788us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191133.537865:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1907
00000100:00100000:2.0:1776191133.538477:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191133.538799:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613781248
00000100:00100000:1.0:1776191133.538878:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2154
00000100:00100000:1.0:1776191133.538890:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e72cee95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613781248:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00000100:00100000:3.0:1776191133.538900:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613781120
00000100:00100000:3.0:1776191133.538938:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4343
00000100:00100000:3.0:1776191133.538942:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dfe84e20 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613781120:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191133.538995:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dfe84e20 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613781120:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 52us (1990us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191133.539002:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4343
00010000:02020000:1.0:1776191133.539619:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191133.539664:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e72cee95 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613781248:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 779us (1189us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191133.539673:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2154
00010000:00010000:3.0:1776191133.690229:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191134.714267:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191134.970446:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1776191134.970460:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a63ab978 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630863104:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191134.970525:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191134.970699:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630863104
00000100:00100000:0.0:1776191134.970752:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2961
00000100:00100000:0.0:1776191134.970758:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000067e0c0a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630863104:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191134.970800:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191134.970859:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000067e0c0a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630863104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (335us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191134.970867:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2961
00000100:00100000:3.0:1776191134.970955:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a63ab978 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630863104:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191135.738345:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191135.996109:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006605fbf0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630863168:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191135.996191:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191135.996271:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630863168
00000100:00100000:0.0:1776191135.996321:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2962
00000100:00100000:0.0:1776191135.996328:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027bfcbd4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630863168:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191135.996359:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191135.996410:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027bfcbd4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630863168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (220us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191135.996416:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2962
00000100:00100000:3.0:1776191135.996576:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006605fbf0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630863168:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191136.763274:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191137.018254:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776191137.018394:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be243e0e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630863360:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191137.018462:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191137.018469:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055aaefe0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630863296:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191137.018520:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191137.018579:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630863296
00000100:00100000:3.0:1776191137.018624:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1646
00000100:00100000:3.0:1776191137.018630:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b9375c8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630863296:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191137.018673:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b9375c8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630863296:12345-0@lo:400:kworker/u8:2.0 Request processed in 42us (153us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191137.018680:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1646
00000100:00100000:3.0:1776191137.018711:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000950cd033 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630863488:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191137.018734:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000062801b3d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630863424:0@lo:400:kworker/u8:2.0
00000100:00080000:0.0:1776191137.019589:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191137.019594:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191137.019597:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191137.019602:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3669
00000100:00080000:0.0:1776191137.019605:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191137.019609:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191137.019627:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000000ee2fc84 x1862467630863808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191137.019642:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191137.019646:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191137.019647:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191137.019650:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3669
00000100:00080000:0.0:1776191137.019652:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191137.019655:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191137.019667:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000009c1848a5 x1862467630863872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191137.019756:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630863360
00000100:00100000:0.0:1776191137.019788:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4344
00000100:00100000:0.0:1776191137.019793:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e555734e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630863360:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191137.022188:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191137.022194:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191137.022256:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000069c1692e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630863744:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191137.022300:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191137.022311:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000016dc0009 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630863232:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191137.022320:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191137.022327:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ae1da2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630863680:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191137.022352:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191137.022363:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191137.022400:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ee2fc84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630863808:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191137.022421:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191137.022436:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c1848a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630863872:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191137.022454:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191137.022500:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630863424
00000100:00100000:3.0:1776191137.022505:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630863488
00000100:00100000:1.0:1776191137.022552:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2963
00000100:00100000:3.0:1776191137.022558:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630863232
00000100:00100000:1.0:1776191137.022559:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eefb5d99 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630863424:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191137.022578:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1495
00000100:00100000:3.0:1776191137.022583:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2c7adec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630863488:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191137.022607:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191137.022622:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eefb5d99 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630863424:12345-0@lo:400:kworker/u8:2.0 Request processed in 62us (430us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191137.022646:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2c7adec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630863488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (464us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191137.022653:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1495
00000100:00100000:3.0:1776191137.022667:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1496
00000100:00100000:3.0:1776191137.022670:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bed67ee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630863232:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191137.022679:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191137.022697:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bed67ee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630863232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 26us (347us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191137.022702:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1496
00000100:00100000:3.0:1776191137.022717:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630863744
00000100:00100000:1.0:1776191137.022886:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2963
00000100:00100000:1.0:1776191137.022921:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000062801b3d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630863424:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191137.022934:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000016dc0009 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630863232:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191137.022980:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630863680
00000100:00100000:3.0:1776191137.022994:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630863808
00000100:00100000:0.0:1776191137.023197:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e555734e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630863360:12345-0@lo:400:kworker/u8:2.0 Request processed in 3402us (4736us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191137.023205:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4344
00000100:00100000:1.0:1776191137.023881:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630863872
00000100:00100000:3.0:1776191137.024466:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1908
00000100:00100000:3.0:1776191137.024476:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de02bb16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630863744:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191137.024559:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de02bb16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630863744:12345-0@lo:400:kworker/u8:2.0 Request processed in 83us (2258us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191137.024566:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1908
00000100:00100000:3.0:1776191137.024580:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1909
00000100:00100000:3.0:1776191137.024583:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000138721a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630863680:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191137.024622:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000138721a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630863680:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (2260us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191137.024631:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1909
00000100:00100000:3.0:1776191137.024644:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2155
00000100:00100000:3.0:1776191137.024653:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000819bd127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630863808:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191137.024891:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191137.024931:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000819bd127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630863808:12345-0@lo:8:kworker/u8:2.0 Request processed in 277us (2509us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191137.024937:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2155
00000100:00100000:3.0:1776191137.025109:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2156
00000100:00100000:3.0:1776191137.025119:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ff9f217e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630863872:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191137.025224:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191137.025415:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ff9f217e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630863872:12345-0@lo:8:kworker/u8:2.0 Request processed in 294us (2960us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191137.025421:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2156
00000100:00080000:3.0:1776191137.025489:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191137.025493:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191137.025502:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ee2fc84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630863808:0@lo:8:kworker/u8:2.0
00000100:00080000:3.0:1776191137.025522:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191137.025524:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191137.025527:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c1848a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630863872:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191137.025575:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ae1da2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630863680:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191137.025585:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000069c1692e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630863744:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191137.025605:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000950cd033 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630863488:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191137.025682:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004c049762 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630863616:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191137.025844:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191137.025877:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000934a8884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630864000:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191137.025902:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191137.025929:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be243e0e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630863360:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191137.025943:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:3.0:1776191137.025954:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000746b7981 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630863552:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191137.025983:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191137.025999:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cec144c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630863936:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191137.026024:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191137.026075:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630864000
00000100:00100000:3.0:1776191137.026110:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630863552
00000100:00100000:3.0:1776191137.026124:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630863936
00000100:00100000:3.0:1776191137.026138:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4345
00000100:00100000:3.0:1776191137.026141:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004faaa807 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630864000:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191137.026194:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004faaa807 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630864000:12345-0@lo:400:kworker/u8:2.0 Request processed in 52us (292us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191137.026204:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4345
00000100:00100000:3.0:1776191137.026216:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4346
00000100:00100000:3.0:1776191137.026224:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb4cf93d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630863552:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191137.026421:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb4cf93d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630863552:12345-0@lo:400:kworker/u8:2.0 Request processed in 195us (441us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191137.026427:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4346
00000100:00100000:3.0:1776191137.026438:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4347
00000100:00100000:3.0:1776191137.026441:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ec7cac8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630863936:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191137.026465:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ec7cac8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630863936:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (441us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191137.026480:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4347
00000100:00100000:3.0:1776191137.026532:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000746b7981 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630863552:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191137.026550:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cec144c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630863936:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191137.026557:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000934a8884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630864000:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191137.026606:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055aaefe0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630863296:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191137.026947:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630863616
00000100:00100000:3.0:1776191137.026982:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2964
00000100:00100000:3.0:1776191137.026986:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bfc0fcff pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630863616:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191137.027024:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bfc0fcff pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630863616:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (1296us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191137.027030:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2964
00000100:00100000:3.0:1776191137.027075:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004c049762 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630863616:0@lo:400:kworker/u8:2.0
00010000:00010000:0.0:1776191137.786533:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191138.652745:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191138.652867:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191138.652913:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191138.652941:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191138.652980:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613781504
00000100:00100000:0.0:1776191138.653015:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613781312
00000100:00100000:1.0:1776191138.653069:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1910
00000100:00100000:1.0:1776191138.653076:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000950cd033 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613781504:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191138.653086:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1647
00000100:00100000:0.0:1776191138.653093:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fec76140 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613781312:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191138.653149:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fec76140 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613781312:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 56us (236us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191138.653157:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1647
00000100:00100000:1.0:1776191138.655843:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000950cd033 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613781504:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 2759us (2968us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191138.655860:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1910
00000100:00100000:0.0:1776191138.656341:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191138.656379:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613781568
00000100:00100000:0.0:1776191138.656414:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2157
00000100:00100000:3.0:1776191138.656420:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613781376
00000100:00100000:0.0:1776191138.656421:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000d20c9eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613781568:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00000100:00100000:3.0:1776191138.656459:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613781440
00000100:00100000:3.0:1776191138.656486:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4348
00000100:00100000:3.0:1776191138.656512:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028951562 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613781376:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00010000:02020000:0.0:1776191138.656532:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191138.656584:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000d20c9eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613781568:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 159us (241us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191138.656584:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4349
00000100:00100000:3.0:1776191138.656592:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028951562 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613781376:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 76us (3852us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191138.656601:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2157
00000100:00100000:2.0:1776191138.656602:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016dc0009 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613781440:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191138.656610:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4348
00000100:00100000:2.0:1776191138.656748:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016dc0009 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613781440:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 153us (3807us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191138.656756:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4349
00010000:00010000:0.0:1776191138.812296:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191139.834252:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191140.090293:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191140.090311:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a63ab978 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630864064:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191140.090381:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191140.090616:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630864064
00000100:00100000:2.0:1776191140.090674:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2965
00000100:00100000:2.0:1776191140.090680:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d1e8454 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630864064:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191140.090712:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191140.090761:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d1e8454 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630864064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (381us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191140.090768:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2965
00000100:00100000:0.0:1776191140.090850:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a63ab978 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630864064:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191140.860789:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191141.115854:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191141.115876:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048ee9cec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630864128:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191141.115941:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191141.116074:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630864128
00000100:00100000:1.0:1776191141.116126:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2966
00000100:00100000:1.0:1776191141.116132:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001f598cfd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630864128:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191141.116162:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191141.116249:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001f598cfd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630864128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (309us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191141.116257:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2966
00000100:00100000:3.0:1776191141.116569:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048ee9cec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630864128:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191141.882238:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191142.138353:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000caebeb11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630864320:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191142.138434:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191142.138459:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191142.138465:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048ee9cec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630864384:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191142.138492:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191142.138533:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630864320
00000100:00100000:0.0:1776191142.138558:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055aaefe0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630864192:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191142.138588:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1648
00000100:00100000:3.0:1776191142.138598:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cdaa8581 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630864320:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191142.138599:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191142.138628:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006605fbf0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630864448:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191142.138655:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cdaa8581 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630864320:12345-0@lo:400:kworker/u8:4.0 Request processed in 58us (228us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191142.138663:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1648
00000100:00100000:0.0:1776191142.138667:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191142.138693:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191142.138699:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a63ab978 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630864256:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191142.138708:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630864448
00000100:00100000:0.0:1776191142.138730:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191142.138752:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2967
00000100:00100000:3.0:1776191142.138758:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002c9bae2d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630864448:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191142.138773:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630864384
00000100:00100000:3.0:1776191142.138802:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002c9bae2d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630864448:12345-0@lo:400:kworker/u8:4.0 Request processed in 42us (135us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191142.138809:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4350
00000100:00100000:3.0:1776191142.138812:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2967
00000100:00100000:0.0:1776191142.138817:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a426c55 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630864384:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191142.138848:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630864192
00000100:00100000:0.0:1776191142.138855:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a426c55 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630864384:12345-0@lo:400:kworker/u8:4.0 Request processed in 38us (361us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191142.138862:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4350
00000100:00100000:3.0:1776191142.138876:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630864256
00000100:00100000:3.0:1776191142.138914:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1497
00000100:00100000:3.0:1776191142.138917:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070c80d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630864192:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191142.138938:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191142.138966:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070c80d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630864192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (371us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191142.138971:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1497
00000100:00100000:3.0:1776191142.138984:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1498
00000100:00100000:3.0:1776191142.138987:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000321faac3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630864256:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191142.138996:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191142.139017:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000321faac3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630864256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 29us (288us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191142.139023:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1498
00000100:00100000:0.0:1776191142.139098:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a63ab978 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630864256:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191142.139115:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048ee9cec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630864384:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191142.139127:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000caebeb11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630864320:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191142.139252:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006605fbf0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630864448:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191142.139271:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055aaefe0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630864192:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191142.140645:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00080000:1.0:1776191142.140692:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191142.140697:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191142.140701:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191142.140708:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3675
00000100:00080000:1.0:1776191142.140711:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191142.140716:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191142.140735:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000014441fbb x1862467630864640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191142.140750:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191142.140754:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191142.140756:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191142.140759:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3675
00000100:00080000:1.0:1776191142.140761:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191142.140763:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191142.140775:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000f97d550a x1862467630864704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191142.140936:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d0e4254d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630864576:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191142.140989:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191142.141017:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776191142.141023:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006605fbf0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630864768:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191142.141311:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191142.141350:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630864576
00000100:00100000:3.0:1776191142.141378:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1776191142.141389:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000caebeb11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630864832:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191142.141395:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2968
00000100:00100000:2.0:1776191142.141401:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a63ab978 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630864576:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191142.141422:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191142.141469:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a63ab978 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630864576:12345-0@lo:400:kworker/u8:4.0 Request processed in 66us (479us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191142.141476:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2968
00000100:00100000:3.0:1776191142.141491:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630864768
00000100:00100000:2.0:1776191142.141515:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0e4254d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630864576:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191142.141536:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630864832
00000100:00100000:3.0:1776191142.141560:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4351
00000100:00100000:3.0:1776191142.141565:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030c9704c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630864768:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191142.141570:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4352
00000100:00100000:2.0:1776191142.141576:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000939787e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630864832:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191142.141611:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030c9704c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630864768:12345-0@lo:400:kworker/u8:4.0 Request processed in 45us (300us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191142.141619:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4351
00000100:00100000:2.0:1776191142.141625:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000939787e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630864832:12345-0@lo:400:kworker/u8:4.0 Request processed in 47us (203us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191142.141633:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4352
00000100:00100000:2.0:1776191142.141663:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000caebeb11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630864832:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191142.141680:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006605fbf0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630864768:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191142.141706:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014441fbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630864640:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191142.142123:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191142.142154:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f97d550a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630864704:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191142.142345:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630864640
00000100:00100000:3.0:1776191142.142371:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2158
00000100:00100000:3.0:1776191142.142376:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1bce22f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630864640:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191142.142529:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:02020000:3.0:1776191142.142556:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191142.142574:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630864704
00000100:00100000:3.0:1776191142.142597:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1bce22f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630864640:12345-0@lo:8:kworker/u8:4.0 Request processed in 220us (475us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191142.142602:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2159
00000100:00100000:3.0:1776191142.142612:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2158
00000100:00100000:2.0:1776191142.142613:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc0375a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630864704:12345-0@lo:8:kworker/u8:4.0
00000100:00080000:3.0:1776191142.142656:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191142.142661:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191142.142664:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014441fbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630864640:0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191142.142702:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191142.142733:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc0375a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630864704:12345-0@lo:8:kworker/u8:4.0 Request processed in 124us (560us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191142.142743:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2159
00000100:00080000:3.0:1776191142.143356:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191142.143361:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191142.143365:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f97d550a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630864704:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191142.144700:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000155ae841 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630864512:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191142.144760:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191142.144916:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630864512
00000100:00100000:3.0:1776191142.144960:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4353
00000100:00100000:3.0:1776191142.144966:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000c128c04 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630864512:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191142.145270:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000c128c04 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630864512:12345-0@lo:400:kworker/u8:4.0 Request processed in 303us (510us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191142.145278:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4353
00000100:00100000:0.0:1776191142.145347:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000155ae841 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630864512:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191142.906265:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191143.771409:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191143.771451:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191143.771524:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191143.771555:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613781632
00000100:00100000:2.0:1776191143.771562:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191143.771612:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1649
00000100:00100000:0.0:1776191143.771615:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613781824
00000100:00100000:1.0:1776191143.771620:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009803db2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613781632:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191143.771652:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1911
00000100:00100000:0.0:1776191143.771658:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c904ec5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613781824:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191143.771697:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009803db2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613781632:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 76us (295us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191143.771699:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c904ec5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613781824:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 39us (175us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191143.771718:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1649
00000100:00100000:0.0:1776191143.771719:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1911
00000100:00100000:2.0:1776191143.771995:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191143.772069:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613781696
00000100:00100000:0.0:1776191143.772128:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613781760
00000100:00100000:0.0:1776191143.772151:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4354
00000100:00100000:0.0:1776191143.772155:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1bce22f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613781696:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191143.772191:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1bce22f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613781696:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 35us (741us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191143.772198:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4354
00000100:00100000:0.0:1776191143.772210:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4355
00000100:00100000:0.0:1776191143.772213:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dcce9244 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613781760:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191143.772237:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dcce9244 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613781760:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 23us (677us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191143.772242:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4355
00000100:00100000:1.0:1776191143.772533:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613781888
00000100:00100000:1.0:1776191143.772608:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2160
00000100:00100000:1.0:1776191143.772613:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001abea6d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613781888:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:1.0:1776191143.772706:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191143.772750:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001abea6d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613781888:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 136us (756us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191143.772757:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2160
00010000:00010000:0.0:1776191143.930758:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191144.954904:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191145.210410:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087950b98 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630864896:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191145.210477:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191145.210616:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630864896
00000100:00100000:0.0:1776191145.210668:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2969
00000100:00100000:0.0:1776191145.210674:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000150035b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630864896:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191145.210706:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191145.210756:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000150035b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630864896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (279us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191145.210764:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2969
00000100:00100000:3.0:1776191145.210841:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087950b98 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630864896:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191145.978529:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191146.235368:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191146.235384:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048ee9cec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630864960:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191146.235443:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191146.235508:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630864960
00000100:00100000:1.0:1776191146.235818:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2970
00000100:00100000:1.0:1776191146.235825:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007582ba84 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630864960:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191146.235860:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191146.235916:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007582ba84 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630864960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (474us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191146.235926:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2970
00000100:00100000:3.0:1776191146.235996:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048ee9cec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630864960:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191147.002202:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191147.258415:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776191147.258435:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005be56c88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630865024:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191147.258504:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191147.258551:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630865024
00000100:00100000:2.0:1776191147.258585:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1650
00000100:00100000:2.0:1776191147.258591:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000364ff3a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630865024:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191147.258635:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000364ff3a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630865024:12345-0@lo:400:kworker/u8:4.0 Request processed in 44us (141us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191147.258642:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1650
00000100:00100000:2.0:1776191147.258683:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005be56c88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630865024:0@lo:400:kworker/u8:4.0
00000100:00080000:3.0:1776191147.260661:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191147.260668:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191147.260670:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191147.260677:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3680
00000100:00080000:3.0:1776191147.260680:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191147.260685:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191147.260705:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000ecd900ea x1862467630865536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191147.260719:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191147.260722:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191147.260724:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191147.260726:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3680
00000100:00080000:3.0:1776191147.260728:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191147.260731:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191147.260741:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000b92c4097 x1862467630865600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191147.260779:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c6718b89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630865152:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191147.260825:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191147.260848:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f43f1e37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630865408:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191147.260869:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191147.260888:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [2->3]
00000100:00100000:3.0:1776191147.260894:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028cc0665 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630865088:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191147.260916:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191147.260937:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d5dde41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630865344:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191147.260965:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191147.260979:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f5a166e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630865728:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191147.260999:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191147.261025:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ecd900ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630865536:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191147.261062:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191147.261077:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b92c4097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630865600:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191147.261101:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191147.261165:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630865152
00000100:00100000:3.0:1776191147.261201:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1499
00000100:00100000:3.0:1776191147.261206:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a1548b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630865152:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191147.261233:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191147.261309:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a1548b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630865152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (485us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191147.261326:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1499
00000100:00100000:3.0:1776191147.261572:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630865088
00000100:00100000:3.0:1776191147.261598:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630865728
00000100:00100000:3.0:1776191147.261615:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4356
00000100:00100000:3.0:1776191147.261618:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001d7d2914 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630865088:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191147.261650:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001d7d2914 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630865088:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (734us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191147.261656:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4356
00000100:00100000:3.0:1776191147.261666:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4357
00000100:00100000:3.0:1776191147.261670:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000603b89b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630865728:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191147.261694:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000603b89b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630865728:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (695us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191147.261699:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4357
00000100:00100000:3.0:1776191147.261720:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630865408
00000100:00100000:3.0:1776191147.261876:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630865536
00000100:00100000:3.0:1776191147.261891:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630865600
00000100:00100000:3.0:1776191147.261902:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1912
00000100:00100000:3.0:1776191147.261906:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dcd4c128 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630865408:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191147.261937:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dcd4c128 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630865408:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (1067us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191147.261943:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1912
00000100:00100000:3.0:1776191147.261967:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2161
00000100:00100000:3.0:1776191147.261970:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a27cd066 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630865536:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191147.262464:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191147.262578:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a27cd066 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630865536:12345-0@lo:8:kworker/u8:4.0 Request processed in 606us (1515us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191147.262586:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2161
00000100:00100000:3.0:1776191147.262600:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2162
00000100:00100000:3.0:1776191147.262603:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000079aa8992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630865600:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191147.262685:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191147.262708:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000079aa8992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630865600:12345-0@lo:8:kworker/u8:4.0 Request processed in 104us (1611us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191147.262714:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2162
00000100:00100000:3.0:1776191147.262757:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028cc0665 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630865088:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191147.262769:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f5a166e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630865728:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191147.262783:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c6718b89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630865152:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191147.262793:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f43f1e37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630865408:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191147.262848:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630865344
00000100:00100000:3.0:1776191147.262876:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2971
00000100:00100000:3.0:1776191147.262880:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004831c73f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630865344:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191147.262915:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004831c73f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630865344:12345-0@lo:400:kworker/u8:4.0 Request processed in 34us (1949us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191147.262923:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2971
00000100:00080000:3.0:1776191147.262949:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191147.262965:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191147.262968:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ecd900ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630865536:0@lo:8:kworker/u8:4.0
00000100:00080000:3.0:1776191147.262977:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191147.262979:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191147.262982:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b92c4097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630865600:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191147.263007:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d5dde41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630865344:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191147.263025:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045d4856e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630865216:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191147.263071:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191147.263099:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ef14d805 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630865472:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191147.263119:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191147.263134:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:3.0:1776191147.263139:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037d4716c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630865280:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191147.263159:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191147.263172:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003af595e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630865664:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191147.263189:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191147.263211:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630865472
00000100:00100000:3.0:1776191147.263235:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1913
00000100:00100000:3.0:1776191147.263239:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cea0d9c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630865472:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191147.263270:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cea0d9c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630865472:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (151us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191147.263276:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1913
00000100:00100000:3.0:1776191147.263294:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630865280
00000100:00100000:3.0:1776191147.263326:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630865664
00000100:00100000:3.0:1776191147.263357:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4358
00000100:00100000:3.0:1776191147.263360:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000010d41dfd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630865280:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191147.263389:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000010d41dfd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630865280:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (231us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191147.263395:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4358
00000100:00100000:3.0:1776191147.263406:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4359
00000100:00100000:3.0:1776191147.263409:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036033aa5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630865664:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191147.263434:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036033aa5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630865664:12345-0@lo:400:kworker/u8:4.0 Request processed in 24us (244us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191147.263439:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4359
00000100:00100000:3.0:1776191147.263460:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630865216
00000100:00100000:3.0:1776191147.263480:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2972
00000100:00100000:3.0:1776191147.263483:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ea5b1fb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630865216:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191147.264913:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d8b8f221 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630865792:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191147.264962:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191147.265010:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630865792
00000100:00100000:0.0:1776191147.265158:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037d4716c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630865280:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191147.265173:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003af595e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630865664:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191147.265183:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ef14d805 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630865472:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191147.265244:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1500
00000100:00100000:0.0:1776191147.265249:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de454674 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630865792:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191147.265270:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191147.265308:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de454674 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630865792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (347us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191147.265326:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1500
00000100:00100000:2.0:1776191147.265493:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d8b8f221 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630865792:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191147.266444:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ea5b1fb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630865216:12345-0@lo:400:kworker/u8:4.0 Request processed in 2957us (3370us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191147.266453:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2972
00000100:00100000:0.0:1776191147.266628:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045d4856e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630865216:0@lo:400:kworker/u8:4.0
00010000:00010000:0.0:1776191148.026375:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191148.890350:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191148.890619:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191148.890792:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191148.890851:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613782016
00000100:00100000:0.0:1776191148.890909:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4360
00000100:00100000:0.0:1776191148.890916:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8b8f221 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613782016:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191148.890994:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8b8f221 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613782016:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 76us (651us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191148.891002:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4360
00000100:00100000:1.0:1776191148.891926:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613782208
00000100:00100000:1.0:1776191148.892003:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613782144
00000100:00100000:3.0:1776191148.892004:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191148.892061:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1914
00000100:00100000:0.0:1776191148.892065:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000087950b98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613782144:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191148.892080:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191148.892106:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000087950b98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613782144:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 39us (1316us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191148.892111:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1914
00000100:00100000:0.0:1776191148.892122:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2163
00000100:00100000:0.0:1776191148.892125:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c6718b89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613782208:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00000100:00100000:3.0:1776191148.892192:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613782080
00010000:02020000:0.0:1776191148.892230:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191148.892235:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4361
00000100:00100000:3.0:1776191148.892241:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008074d522 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613782080:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191148.892263:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c6718b89 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613782208:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 136us (1644us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191148.892271:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2163
00000100:00100000:3.0:1776191148.892289:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008074d522 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613782080:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 38us (202us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191148.892298:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4361
00000100:00100000:0.0:1776191148.892312:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613781952
00000100:00100000:0.0:1776191148.892346:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1651
00000100:00100000:0.0:1776191148.892352:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ea43294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613781952:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191148.892388:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ea43294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613781952:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 36us (388us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191148.892394:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1651
00010000:00010000:3.0:1776191149.050573:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191150.074369:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191150.330592:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005be56c88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630865856:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191150.330660:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191150.331369:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630865856
00000100:00100000:3.0:1776191150.331423:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2973
00000100:00100000:3.0:1776191150.331429:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001ca7e4d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630865856:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191150.331460:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191150.331558:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001ca7e4d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630865856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (899us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191150.331566:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2973
00000100:00100000:1.0:1776191150.331917:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005be56c88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630865856:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191151.098284:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191151.354460:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048ee9cec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630865920:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191151.354534:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191151.354624:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630865920
00000100:00100000:0.0:1776191151.354665:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2974
00000100:00100000:0.0:1776191151.354670:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005be56c88 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630865920:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191151.354700:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191151.354747:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005be56c88 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630865920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (214us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191151.354754:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2974
00000100:00100000:2.0:1776191151.354832:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048ee9cec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630865920:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191152.122767:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191152.380216:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5f2099 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630865984:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191152.380291:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191152.380323:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d5dde41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630866240:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191152.380324:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630865984
00000100:00100000:1.0:1776191152.380353:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191152.380375:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:1.0:1776191152.380381:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa646f87 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630866048:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191152.380406:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191152.380418:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f43f1e37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630866304:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191152.380439:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191152.380463:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630866240
00000100:00100000:1.0:1776191152.380497:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4362
00000100:00100000:1.0:1776191152.380502:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f97d550a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630866240:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191152.380561:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f97d550a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630866240:12345-0@lo:400:kworker/u8:2.0 Request processed in 57us (208us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191152.380665:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1501
00000100:00100000:0.0:1776191152.380670:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000155ae841 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630865984:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191152.380693:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191152.380728:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000155ae841 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630865984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (439us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191152.380734:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1501
00000100:00100000:0.0:1776191152.380756:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630866304
00000100:00100000:0.0:1776191152.380777:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2975
00000100:00100000:0.0:1776191152.380781:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb519ed0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630866304:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191152.380810:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb519ed0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630866304:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (371us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191152.380815:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2975
00000100:00100000:0.0:1776191152.380850:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630866048
00000100:00100000:0.0:1776191152.380872:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1652
00000100:00100000:0.0:1776191152.380875:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d186bef1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630866048:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191152.380903:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d186bef1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630866048:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (497us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191152.380910:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1652
00000100:00100000:0.0:1776191152.381075:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa646f87 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630866048:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191152.381086:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f43f1e37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630866304:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191152.381100:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5f2099 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630865984:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191152.381109:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d5dde41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630866240:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191152.381150:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc7ab3d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630866176:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191152.381176:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191152.381215:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:0.0:1776191152.381221:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053bdf8f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630866112:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191152.381243:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191152.381259:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000d20c9eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630866368:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191152.381279:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191152.381303:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630866368
00000100:00100000:0.0:1776191152.381324:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1502
00000100:00100000:0.0:1776191152.381328:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c1848a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630866368:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191152.381338:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191152.381597:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c1848a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630866368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 268us (317us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191152.381605:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1502
00000100:00080000:3.0:1776191152.381644:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191152.381649:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191152.381652:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191152.381658:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3685
00000100:00080000:3.0:1776191152.381660:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191152.381665:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191152.381682:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000f43f1e37 x1862467630866496/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191152.381696:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191152.381699:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191152.381700:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191152.381703:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3685
00000100:00080000:3.0:1776191152.381704:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191152.381707:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191152.381717:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000003af595e4 x1862467630866560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191152.381766:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630866112
00000100:00100000:0.0:1776191152.381788:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d5dde41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630866432:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191152.381796:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4363
00000100:00100000:3.0:1776191152.381800:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cec144c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630866112:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191152.381834:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cec144c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630866112:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (591us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191152.381840:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4363
00000100:00100000:3.0:1776191152.381858:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f43f1e37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630866496:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191152.381891:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191152.382055:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053bdf8f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630866112:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191152.382074:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000d20c9eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630866368:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191152.382098:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ecd900ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630866688:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191152.382121:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191152.382133:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191152.382137:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b92c4097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630866624:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191152.382155:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191152.382184:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630866176
00000100:00100000:0.0:1776191152.382222:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2976
00000100:00100000:0.0:1776191152.382227:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000934a8884 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630866176:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191152.382246:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191152.382277:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000934a8884 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630866176:12345-0@lo:400:kworker/u8:2.0 Request processed in 49us (1100us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191152.382284:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2976
00000100:00100000:3.0:1776191152.382308:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630866688
00000100:00100000:3.0:1776191152.382340:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630866624
00000100:00100000:0.0:1776191152.382343:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc7ab3d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630866176:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191152.382365:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4364
00000100:00100000:3.0:1776191152.382370:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000053bdf8f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630866688:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191152.382371:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630866432
00000100:00100000:0.0:1776191152.382401:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630866496
00000100:00100000:3.0:1776191152.382415:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000053bdf8f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630866688:12345-0@lo:400:kworker/u8:2.0 Request processed in 44us (293us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191152.382421:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1915
00000100:00100000:3.0:1776191152.382425:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4364
00000100:00100000:0.0:1776191152.382429:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa646f87 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630866432:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191152.382442:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4365
00000100:00100000:3.0:1776191152.382448:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000d20c9eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630866624:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191152.382472:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa646f87 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630866432:12345-0@lo:400:kworker/u8:2.0 Request processed in 43us (582us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191152.382480:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1915
00000100:00100000:3.0:1776191152.382489:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000d20c9eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630866624:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (332us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191152.382496:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2164
00000100:00100000:3.0:1776191152.382499:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4365
00000100:00100000:0.0:1776191152.382504:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5f2099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630866496:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191152.382595:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191152.382595:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003af595e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630866560:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191152.383161:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4362
00000100:00100000:1.0:1776191152.383280:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b92c4097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630866624:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191152.383294:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5f2099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630866496:12345-0@lo:8:kworker/u8:2.0 Request processed in 786us (1044us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191152.383294:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191152.383295:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ecd900ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630866688:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191152.383343:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d5dde41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630866432:0@lo:400:kworker/u8:2.0
00000100:00080000:2.0:1776191152.383365:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191152.383368:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191152.383371:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f43f1e37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630866496:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191152.383414:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630866560
00000100:00100000:3.0:1776191152.383477:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2165
00000100:00100000:3.0:1776191152.383481:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006eae40ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630866560:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191152.383487:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2164
00010000:02020000:3.0:1776191152.383577:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191152.383623:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006eae40ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630866560:12345-0@lo:8:kworker/u8:2.0 Request processed in 141us (333us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191152.383629:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2165
00000100:00080000:0.0:1776191152.383695:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191152.383699:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191152.383702:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003af595e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630866560:0@lo:8:kworker/u8:2.0
00010000:00010000:0.0:1776191153.146515:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191154.013896:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191154.014083:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191154.014124:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191154.014159:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191154.014246:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191154.014597:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613782464
00000100:00100000:3.0:1776191154.014640:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613782528
00000100:00100000:3.0:1776191154.014656:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1916
00000100:00100000:3.0:1776191154.014663:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ecd900ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613782464:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191154.014726:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ecd900ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613782464:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 63us (566us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191154.014734:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1916
00000100:00100000:1.0:1776191154.014746:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613782400
00000100:00100000:3.0:1776191154.014752:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2166
00000100:00100000:3.0:1776191154.014757:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b92c4097 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613782528:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00000100:00100000:1.0:1776191154.014782:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613782336
00000100:00100000:1.0:1776191154.014803:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4366
00000100:00100000:1.0:1776191154.014808:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f5a166e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613782400:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191154.014842:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f5a166e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613782400:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 33us (760us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191154.014848:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4366
00010000:02020000:3.0:1776191154.014861:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191154.014864:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4367
00000100:00100000:1.0:1776191154.014870:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003af595e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613782336:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191154.014894:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b92c4097 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613782528:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 136us (647us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191154.014902:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003af595e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613782336:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 28us (775us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191154.014908:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2166
00000100:00100000:1.0:1776191154.014913:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4367
00000100:00100000:0.0:1776191154.015324:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613782272
00000100:00100000:0.0:1776191154.015365:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1653
00000100:00100000:0.0:1776191154.015369:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000050bd026a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613782272:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191154.015439:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000050bd026a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613782272:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 69us (1552us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191154.015446:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1653
00010000:00010000:0.0:1776191154.172223:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191155.194379:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191155.450507:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007efd3245 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630866752:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191155.450575:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191155.450695:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630866752
00000100:00100000:1.0:1776191155.450753:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2977
00000100:00100000:1.0:1776191155.450760:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000045d4856e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630866752:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191155.450799:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191155.450855:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000045d4856e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630866752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (280us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191155.450863:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2977
00000100:00100000:3.0:1776191155.450985:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007efd3245 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630866752:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191156.220294:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191156.474382:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e600ea8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630866816:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191156.474452:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191156.474639:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630866816
00000100:00100000:1.0:1776191156.474695:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2978
00000100:00100000:1.0:1776191156.474700:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000021a6ec7f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630866816:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191156.475166:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191156.475228:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000021a6ec7f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630866816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 526us (775us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191156.475235:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2978
00000100:00100000:2.0:1776191156.475329:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e600ea8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630866816:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191157.243220:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1776191157.498330:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191157.498338:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191157.498341:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191157.498350:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3690
00000100:00080000:0.0:1776191157.498353:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191157.498359:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191157.498378:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000ce2fb2ae x1862467630867328/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191157.498393:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191157.498396:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191157.498397:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191157.498400:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3690
00000100:00080000:0.0:1776191157.498402:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191157.498405:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191157.498414:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000074fc7059 x1862467630867392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191157.498448:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ce2fb2ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630867328:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191157.498510:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191157.498536:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000074fc7059 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630867392:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191157.498555:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191157.498660:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a2a7dce2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630867072:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191157.498690:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191157.498715:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000424d0623 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630867456:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191157.498735:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191157.498750:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:2.0:1776191157.498755:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055aaefe0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630867008:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191157.498776:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191157.498788:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000cbdfd62 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630867264:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191157.498806:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191157.499355:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191157.499399:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630867072
00000100:00100000:0.0:1776191157.499448:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630867456
00000100:00100000:0.0:1776191157.499469:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4368
00000100:00100000:0.0:1776191157.499474:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000fc4ac59 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630867072:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191157.499563:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ef14d805 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630866944:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191157.499591:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191157.499611:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000034f2f5bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630867200:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191157.499630:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191157.499644:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053a7c6a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630867584:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191157.499664:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191157.499681:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [2->3]
00000100:00100000:1.0:1776191157.499687:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc7ab3d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630866880:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191157.499713:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191157.499726:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004bce44f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630867136:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191157.499746:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191157.499759:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000090a9e988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630867520:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191157.499779:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191157.499808:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630867328
00000100:00100000:1.0:1776191157.499834:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630867392
00000100:00100000:1.0:1776191157.499846:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630867264
00000100:00100000:1.0:1776191157.499859:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630867200
00000100:00100000:1.0:1776191157.499869:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1917
00000100:00100000:1.0:1776191157.499873:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af1b2795 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630867264:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191157.499936:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1918
00000100:00100000:3.0:1776191157.499942:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006605fbf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630867200:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191157.499983:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006605fbf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630867200:12345-0@lo:400:kworker/u8:4.0 Request processed in 40us (352us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191157.499990:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1918
00000100:00100000:3.0:1776191157.500006:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2167
00000100:00100000:3.0:1776191157.500009:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000994ca5e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630867328:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191157.500130:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191157.500165:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000994ca5e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630867328:12345-0@lo:8:kworker/u8:4.0 Request processed in 155us (1656us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191157.500171:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2167
00000100:00100000:3.0:1776191157.500181:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2168
00000100:00100000:3.0:1776191157.500184:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af172616 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630867392:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191157.500267:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191157.500291:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af172616 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630867392:12345-0@lo:8:kworker/u8:4.0 Request processed in 105us (1735us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191157.500297:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2168
00000100:00100000:3.0:1776191157.500318:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630866944
00000100:00100000:3.0:1776191157.500340:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630867520
00000100:00100000:3.0:1776191157.500352:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4369
00000100:00100000:3.0:1776191157.500355:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007efd3245 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630867456:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191157.500600:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037d4716c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630867648:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191157.500632:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191157.500707:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000fc4ac59 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630867072:12345-0@lo:400:kworker/u8:4.0 Request processed in 1232us (2017us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191157.500715:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4368
00000100:00100000:0.0:1776191157.500731:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4370
00000100:00100000:0.0:1776191157.500735:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000014441fbb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630866944:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191157.500763:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000014441fbb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630866944:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (1171us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191157.500768:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4370
00000100:00100000:0.0:1776191157.500778:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4371
00000100:00100000:0.0:1776191157.500781:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e600ea8b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630867520:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191157.500805:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e600ea8b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630867520:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (1026us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191157.500814:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4371
00000100:00100000:0.0:1776191157.500834:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630867008
00000100:00100000:0.0:1776191157.500858:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630867136
00000100:00100000:0.0:1776191157.500868:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2979
00000100:00100000:0.0:1776191157.500871:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d7d52e7c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630867008:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191157.500898:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d7d52e7c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630867008:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (2122us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191157.500903:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2979
00000100:00100000:0.0:1776191157.500917:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2980
00000100:00100000:0.0:1776191157.500920:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d0e4254d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630867136:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191157.500945:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d0e4254d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630867136:12345-0@lo:400:kworker/u8:4.0 Request processed in 24us (1199us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191157.500950:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2980
00000100:00080000:0.0:1776191157.500980:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191157.500984:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191157.500988:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ce2fb2ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630867328:0@lo:8:kworker/u8:4.0
00000100:00080000:0.0:1776191157.500997:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191157.500999:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191157.501002:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000074fc7059 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630867392:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191157.501062:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630867584
00000100:00100000:0.0:1776191157.501083:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630867648
00000100:00100000:0.0:1776191157.501112:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1503
00000100:00100000:0.0:1776191157.501116:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000caebeb11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630867584:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191157.501136:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191157.501167:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000caebeb11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630867584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (1502us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191157.501174:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1503
00000100:00100000:0.0:1776191157.501185:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1504
00000100:00100000:0.0:1776191157.501188:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000056503154 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3364:x1862467630867648:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191157.501197:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191157.501217:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000056503154 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3364:x1862467630867648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 28us (586us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191157.501222:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1504
00000100:00100000:0.0:1776191157.501280:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630866880
00000100:00100000:0.0:1776191157.501302:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1654
00000100:00100000:0.0:1776191157.501305:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008cbd400d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630866880:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191157.501333:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008cbd400d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630866880:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (1620us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191157.501339:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1654
00000100:00100000:0.0:1776191157.501395:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc7ab3d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630866880:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191157.501405:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004bce44f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630867136:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191157.501415:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000090a9e988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630867520:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191157.501425:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ef14d805 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630866944:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191157.501433:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000034f2f5bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630867200:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191157.501444:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053a7c6a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630867584:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191157.501922:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af1b2795 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630867264:12345-0@lo:400:kworker/u8:4.0 Request processed in 2046us (3113us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191157.501929:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1917
00000100:00100000:2.0:1776191157.501986:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000cbdfd62 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630867264:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191157.501998:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a2a7dce2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630867072:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191157.502062:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007efd3245 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630867456:12345-0@lo:400:kworker/u8:4.0 Request processed in 1705us (3327us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191157.502069:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4369
00000100:00100000:2.0:1776191157.502169:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000424d0623 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630867456:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191157.502262:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037d4716c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630867648:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191157.502273:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055aaefe0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630867008:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191158.266570:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191159.136593:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191159.136640:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191159.136673:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191159.136706:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191159.136730:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191159.136803:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613782656
00000100:00100000:3.0:1776191159.136869:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613782720
00000100:00100000:3.0:1776191159.136890:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4372
00000100:00100000:3.0:1776191159.136896:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000055aaefe0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613782656:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191159.136981:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000055aaefe0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613782656:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 84us (341us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191159.136990:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4372
00000100:00100000:3.0:1776191159.137007:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4373
00000100:00100000:3.0:1776191159.137013:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000242c8400 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613782720:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191159.137029:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613782784
00000100:00100000:3.0:1776191159.137073:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000242c8400 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613782720:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 59us (341us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191159.137079:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4373
00000100:00100000:0.0:1776191159.137173:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613782848
00000100:00100000:3.0:1776191159.137217:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613782592
00000100:00100000:1.0:1776191159.137255:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1919
00000100:00100000:1.0:1776191159.137268:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dbd40b9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613782784:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191159.137269:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2169
00000100:00100000:0.0:1776191159.137278:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d9b79312 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613782848:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00000100:00100000:1.0:1776191159.137315:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dbd40b9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613782784:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 52us (641us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191159.137323:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1919
00010000:02020000:0.0:1776191159.137372:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191159.137408:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d9b79312 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613782848:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 131us (702us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191159.137416:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2169
00000100:00100000:0.0:1776191159.138389:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1655
00000100:00100000:0.0:1776191159.138396:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000afc79a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613782592:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191159.138441:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000afc79a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613782592:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 45us (1857us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191159.138448:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1655
00010000:00010000:0.0:1776191159.290612:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191160.316101:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191160.571339:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191160.571365:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fe4d38b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630867712:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191160.571436:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191160.571534:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630867712
00000100:00100000:2.0:1776191160.571584:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2981
00000100:00100000:2.0:1776191160.571589:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048ee9cec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630867712:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191160.571620:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191160.571684:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048ee9cec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630867712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (248us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191160.571690:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2981
00000100:00100000:1.0:1776191160.571789:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fe4d38b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630867712:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191161.342858:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191161.594349:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f43f1e37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630867776:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191161.594418:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191161.594613:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630867776
00000100:00100000:1.0:1776191161.594656:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2982
00000100:00100000:1.0:1776191161.594661:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c0278cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630867776:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191161.594691:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191161.594738:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c0278cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630867776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (322us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191161.594745:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2982
00000100:00100000:0.0:1776191161.594819:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f43f1e37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630867776:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191162.362277:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1776191162.618289:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191162.618296:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191162.618299:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191162.618307:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3695
00000100:00080000:0.0:1776191162.618311:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191162.618317:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191162.618337:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000034f2f5bc x1862467630868288/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191162.618357:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191162.618360:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191162.618361:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191162.618364:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3695
00000100:00080000:0.0:1776191162.618366:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191162.618369:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191162.618379:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000004bce44f9 x1862467630868352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191162.618420:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000034f2f5bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630868288:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191162.618488:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191162.618515:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004bce44f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630868352:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191162.618535:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191162.618872:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053a7c6a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630867840:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191162.618905:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191162.618931:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000424d0623 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630868096:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191162.618954:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191162.618976:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ce2fb2ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630868480:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191162.619064:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191162.619081:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:3.0:1776191162.619086:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc7ab3d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630868032:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191162.619105:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191162.619117:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000074fc7059 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630868416:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191162.619136:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191162.619160:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000090a9e988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630867968:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191162.619182:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191162.619194:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000cbdfd62 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630868224:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191162.619212:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191162.619224:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:3.0:1776191162.619229:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ef14d805 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630867904:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191162.619268:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191162.619281:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a2a7dce2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630868160:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191162.619300:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191162.619329:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630868480
00000100:00100000:3.0:1776191162.619367:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630868032
00000100:00100000:3.0:1776191162.619383:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630868416
00000100:00100000:3.0:1776191162.619395:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630867904
00000100:00100000:3.0:1776191162.619408:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4374
00000100:00100000:3.0:1776191162.619412:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000037d4716c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630868480:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191162.619462:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000037d4716c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630868480:12345-0@lo:400:kworker/u8:4.0 Request processed in 49us (398us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191162.619469:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4374
00000100:00100000:3.0:1776191162.619483:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4375
00000100:00100000:3.0:1776191162.619487:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003e15780a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630868032:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191162.619509:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003e15780a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630868032:12345-0@lo:400:kworker/u8:4.0 Request processed in 22us (404us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191162.619515:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4375
00000100:00100000:3.0:1776191162.619524:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4376
00000100:00100000:3.0:1776191162.619527:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f8de323 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630868416:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191162.619549:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f8de323 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630868416:12345-0@lo:400:kworker/u8:4.0 Request processed in 21us (413us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191162.619555:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4376
00000100:00100000:3.0:1776191162.619566:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4377
00000100:00100000:3.0:1776191162.619569:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f6732c2c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630867904:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191162.619593:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f6732c2c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630867904:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (324us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191162.619598:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4377
00000100:00100000:3.0:1776191162.619630:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ef14d805 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630867904:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191162.619651:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc7ab3d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630868032:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191162.619658:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000074fc7059 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630868416:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191162.619665:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ce2fb2ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630868480:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191162.619907:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630868288
00000100:00100000:2.0:1776191162.619932:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630868352
00000100:00100000:1.0:1776191162.619940:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002200bdf2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630868544:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191162.619948:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630868224
00000100:00100000:2.0:1776191162.619965:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630868160
00000100:00100000:2.0:1776191162.619992:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1920
00000100:00100000:2.0:1776191162.620001:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a8e91aa5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630868224:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191162.620003:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191162.620061:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1921
00000100:00100000:1.0:1776191162.620067:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008790082b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630868160:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191162.620070:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a8e91aa5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630868224:12345-0@lo:400:kworker/u8:4.0 Request processed in 70us (855us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191162.620082:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1920
00000100:00100000:2.0:1776191162.620102:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2170
00000100:00100000:1.0:1776191162.620105:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008790082b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630868160:12345-0@lo:400:kworker/u8:4.0 Request processed in 37us (804us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191162.620109:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006776e411 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630868288:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191162.620117:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1921
00000100:00100000:1.0:1776191162.620133:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2171
00000100:00100000:1.0:1776191162.620137:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8a67d69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630868352:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191162.620814:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:02020000:2.0:1776191162.620824:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191162.620860:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8a67d69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630868352:12345-0@lo:8:kworker/u8:4.0 Request processed in 720us (2323us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191162.620868:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006776e411 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630868288:12345-0@lo:8:kworker/u8:4.0 Request processed in 760us (2380us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191162.620871:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2171
00000100:00100000:2.0:1776191162.620881:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2170
00000100:00100000:1.0:1776191162.620904:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630868096
00000100:00100000:2.0:1776191162.620912:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630867968
00000100:00100000:1.0:1776191162.620933:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2983
00000100:00100000:1.0:1776191162.620939:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028cc0665 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630868096:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191162.621051:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191162.621060:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f76e3cf5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630868608:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191162.621086:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191162.621127:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2984
00000100:00100000:2.0:1776191162.621135:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f3626cf8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630867968:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191162.621146:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a2a7dce2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630868160:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191162.621161:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000cbdfd62 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630868224:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191162.621179:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f3626cf8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630867968:12345-0@lo:400:kworker/u8:4.0 Request processed in 44us (1996us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191162.621185:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000090a9e988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630867968:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191162.621189:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2984
00000100:00100000:2.0:1776191162.621244:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630868544
00000100:00100000:2.0:1776191162.621273:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630868608
00000100:00100000:2.0:1776191162.621287:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1505
00000100:00100000:2.0:1776191162.621291:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d5dde41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630868544:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191162.621310:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191162.621344:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d5dde41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630868544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (1346us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191162.621364:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1505
00000100:00100000:2.0:1776191162.621377:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1506
00000100:00100000:2.0:1776191162.621382:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4fb1a2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630868608:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191162.621390:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191162.621413:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4fb1a2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630868608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 31us (326us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191162.621418:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1506
00000100:00100000:2.0:1776191162.621460:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f76e3cf5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630868608:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191162.621473:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002200bdf2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630868544:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191162.621797:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630867840
00000100:00100000:0.0:1776191162.621829:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1656
00000100:00100000:0.0:1776191162.621833:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003026b1b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630867840:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191162.621875:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003026b1b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630867840:12345-0@lo:400:kworker/u8:4.0 Request processed in 41us (2969us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191162.621881:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1656
00000100:00080000:0.0:1776191162.621936:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191162.621941:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191162.621944:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000034f2f5bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630868288:0@lo:8:kworker/u8:4.0
00000100:00080000:0.0:1776191162.621952:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191162.621954:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191162.621957:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004bce44f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630868352:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191162.622008:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053a7c6a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630867840:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191162.624436:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028cc0665 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630868096:12345-0@lo:400:kworker/u8:4.0 Request processed in 3490us (5475us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191162.624450:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2983
00000100:00100000:0.0:1776191162.625766:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000424d0623 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630868096:0@lo:400:kworker/u8:4.0
00010000:00010000:0.0:1776191163.386247:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191164.251374:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191164.251435:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191164.251451:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613783168
00000100:00100000:1.0:1776191164.251467:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191164.251499:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191164.251524:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191164.251556:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613783104
00000100:00100000:2.0:1776191164.251583:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1922
00000100:00100000:2.0:1776191164.251589:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000746b7981 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613783104:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191164.251659:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000746b7981 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613783104:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 69us (192us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191164.251666:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1922
00000100:00100000:2.0:1776191164.251685:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2172
00000100:00100000:2.0:1776191164.251688:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f43f1e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613783168:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:2.0:1776191164.251782:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191164.251808:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f43f1e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613783168:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 118us (442us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191164.251813:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2172
00000100:00100000:2.0:1776191164.252104:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613782912
00000100:00100000:2.0:1776191164.252134:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1657
00000100:00100000:2.0:1776191164.252139:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be2451ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613782912:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191164.252183:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be2451ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613782912:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 43us (684us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191164.252189:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1657
00000100:00100000:3.0:1776191164.252692:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613783040
00000100:00100000:3.0:1776191164.253007:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4378
00000100:00100000:3.0:1776191164.253012:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be243e0e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613783040:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191164.253090:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be243e0e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613783040:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 77us (1566us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191164.253102:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4378
00000100:00100000:1.0:1776191164.253320:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613782976
00000100:00100000:1.0:1776191164.253359:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4379
00000100:00100000:1.0:1776191164.253363:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c049762 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613782976:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191164.253394:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c049762 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613782976:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 30us (1970us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191164.253401:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4379
00010000:00010000:3.0:1776191164.410217:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191165.434490:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191165.690682:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002200bdf2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630868672:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191165.690757:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191165.690924:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630868672
00000100:00100000:1.0:1776191165.690975:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2985
00000100:00100000:1.0:1776191165.690981:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d4e3b26a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630868672:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191165.691019:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191165.692465:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d4e3b26a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630868672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1477us (1703us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191165.692478:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2985
00000100:00100000:2.0:1776191165.692941:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002200bdf2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630868672:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191166.458326:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191166.714750:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191166.715420:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000069c1692e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630868736:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191166.715490:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191166.715636:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630868736
00000100:00100000:2.0:1776191166.715717:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2986
00000100:00100000:2.0:1776191166.715724:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad386bcf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630868736:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191166.715757:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191166.715812:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad386bcf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630868736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (323us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191166.715819:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2986
00000100:00100000:3.0:1776191166.715910:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000069c1692e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630868736:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191167.482992:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1776191167.738931:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191167.738938:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191167.738941:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1776191167.738947:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008cc360bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630868864:0@lo:400:kworker/u8:2.0
00000100:00080000:3.0:1776191167.738949:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3700
00000100:00080000:3.0:1776191167.738954:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191167.738961:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191167.738981:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000808245d5 x1862467630869248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191167.738990:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000005f434a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630868928:0@lo:400:kworker/u8:2.0
00000100:00080000:3.0:1776191167.738997:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191167.739001:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191167.739003:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191167.739006:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3700
00000100:00080000:3.0:1776191167.739008:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191167.739011:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191167.739018:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191167.739025:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000036b83f3c x1862467630869312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191167.739061:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191167.739071:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009df06d88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630869120:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191167.739088:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000df87de4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630869184:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191167.739088:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c82d865 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630868992:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191167.739100:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191167.739125:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [0->1]
00000100:00100000:0.0:1776191167.739131:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000161dca59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630868800:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191167.739138:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191167.739150:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191167.739171:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191167.739177:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009189961c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630869376:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191167.739193:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eae49c12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630869056:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191167.739194:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630868864
00000100:00100000:0.0:1776191167.739218:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191167.739232:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004f22abe6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630869440:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191167.739240:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630868992
00000100:00100000:0.0:1776191167.739252:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191167.739350:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630868928
00000100:00100000:2.0:1776191167.739370:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630869056
00000100:00100000:2.0:1776191167.739384:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2987
00000100:00100000:2.0:1776191167.739389:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ae1da2b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630868928:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191167.739440:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ae1da2b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630868928:12345-0@lo:400:kworker/u8:2.0 Request processed in 50us (408us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191167.739447:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2987
00000100:00100000:2.0:1776191167.739477:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2988
00000100:00100000:2.0:1776191167.739481:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e72cee95 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630869056:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191167.739508:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e72cee95 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630869056:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (291us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191167.739514:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2988
00000100:00100000:2.0:1776191167.739556:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776191167.739563:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002200bdf2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630869504:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191167.739590:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191167.739644:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630869120
00000100:00100000:2.0:1776191167.739666:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630869184
00000100:00100000:2.0:1776191167.739682:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1923
00000100:00100000:2.0:1776191167.739686:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000041c7ca25 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630869120:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191167.739714:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000041c7ca25 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630869120:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (616us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191167.739720:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1923
00000100:00100000:2.0:1776191167.739731:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1924
00000100:00100000:2.0:1776191167.739734:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ee2fc84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630869184:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191167.739758:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ee2fc84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630869184:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (624us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191167.739763:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1924
00000100:00100000:2.0:1776191167.739796:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630869504
00000100:00100000:2.0:1776191167.739816:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1507
00000100:00100000:2.0:1776191167.739820:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe4d38b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630869504:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191167.739838:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191167.739868:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe4d38b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630869504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (277us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191167.739883:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1507
00000100:00100000:2.0:1776191167.739917:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002200bdf2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630869504:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191167.744354:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630869440
00000100:00100000:1.0:1776191167.744419:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4380
00000100:00100000:0.0:1776191167.744557:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009df06d88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630869120:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191167.744718:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000263400d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630868864:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191167.744783:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000263400d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630868864:12345-0@lo:400:kworker/u8:2.0 Request processed in 358us (5767us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191167.744790:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4380
00000100:00100000:1.0:1776191167.744807:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4381
00000100:00100000:1.0:1776191167.744811:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007c94492b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630868992:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191167.744834:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4382
00000100:00100000:1.0:1776191167.744839:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007c94492b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630868992:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (5691us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191167.744844:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000950cd033 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630869440:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191167.744848:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4381
00000100:00100000:1.0:1776191167.744903:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd341e03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630869568:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191167.744942:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191167.744961:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000950cd033 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630869440:12345-0@lo:400:kworker/u8:2.0 Request processed in 117us (5708us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191167.744969:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4382
00000100:00100000:1.0:1776191167.744978:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000005f434a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630868928:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191167.744990:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000df87de4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630869184:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191167.745073:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630869568
00000100:00100000:0.0:1776191167.745107:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eae49c12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630869056:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191167.745120:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004f22abe6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630869440:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191167.745131:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008cc360bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630868864:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191167.745159:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191167.745170:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1508
00000100:00100000:1.0:1776191167.745175:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000062801b3d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630869568:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191167.745189:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191167.745224:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000062801b3d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630869568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (283us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191167.745231:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1508
00000100:00100000:3.0:1776191167.745255:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630869376
00000100:00100000:1.0:1776191167.745265:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd341e03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630869568:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191167.745288:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4383
00000100:00100000:3.0:1776191167.745294:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000053a7c6a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630869376:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191167.745325:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000808245d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630869248:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191167.745356:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191167.745582:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000036b83f3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630869312:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191167.745595:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009189961c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630869376:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191167.745612:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191167.745620:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c82d865 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630868992:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191167.745656:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630869248
00000100:00100000:0.0:1776191167.745666:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630868800
00000100:00100000:1.0:1776191167.745679:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630869312
00000100:00100000:1.0:1776191167.745694:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2173
00000100:00100000:1.0:1776191167.745697:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000069c1692e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630869248:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191167.745927:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2174
00000100:00100000:2.0:1776191167.745932:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ab7db222 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630869312:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191167.745942:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000053a7c6a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630869376:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (170us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191167.745954:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4383
00010000:02020000:2.0:1776191167.746109:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:02020000:1.0:1776191167.746157:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191167.746160:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ab7db222 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630869312:12345-0@lo:8:kworker/u8:2.0 Request processed in 224us (547us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191167.746170:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2174
00000100:00100000:1.0:1776191167.746191:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000069c1692e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630869248:12345-0@lo:8:kworker/u8:2.0 Request processed in 492us (834us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191167.746199:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2173
00000100:00080000:3.0:1776191167.746299:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191167.746304:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191167.746308:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000808245d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630869248:0@lo:8:kworker/u8:2.0
00000100:00080000:3.0:1776191167.746316:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191167.746319:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191167.746321:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000036b83f3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630869312:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191167.746517:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1658
00000100:00100000:0.0:1776191167.746522:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f9c8ab18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630868800:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191167.746570:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f9c8ab18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630868800:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (7401us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191167.746577:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1658
00000100:00100000:1.0:1776191167.746627:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000161dca59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630868800:0@lo:400:kworker/u8:2.0
00010000:00010000:0.0:1776191168.506420:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191169.371236:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191169.371281:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191169.371311:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191169.371349:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613783488
00000100:00100000:2.0:1776191169.371356:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191169.371386:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613783424
00000100:00100000:2.0:1776191169.371399:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191169.371418:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1925
00000100:00100000:1.0:1776191169.371425:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000421d4a36 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613783424:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191169.371441:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613783232
00000100:00100000:2.0:1776191169.371474:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1659
00000100:00100000:2.0:1776191169.371479:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081b9520e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613783232:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191169.371496:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000421d4a36 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613783424:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 69us (183us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191169.371503:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1925
00000100:00100000:2.0:1776191169.371512:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081b9520e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613783232:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 31us (157us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191169.371520:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1659
00000100:00100000:1.0:1776191169.371530:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2175
00000100:00100000:1.0:1776191169.371536:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006821defb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613783488:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00000100:00100000:2.0:1776191169.371556:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613783296
00000100:00100000:2.0:1776191169.371582:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613783360
00000100:00100000:2.0:1776191169.371618:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4384
00000100:00100000:2.0:1776191169.371622:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005f9ce4ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613783296:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00010000:02020000:1.0:1776191169.371627:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191169.371652:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4385
00000100:00100000:2.0:1776191169.371656:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005f9ce4ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613783296:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 32us (427us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191169.371664:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008deca8e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613783360:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191169.371665:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006821defb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613783488:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 124us (380us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191169.371680:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4384
00000100:00100000:1.0:1776191169.371681:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2175
00000100:00100000:0.0:1776191169.371708:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008deca8e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613783360:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 47us (309us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191169.371716:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4385
00010000:00010000:0.0:1776191169.530516:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191170.554604:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191170.811244:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1776191170.811259:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de02bb16 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630869632:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191170.811324:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191170.812128:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630869632
00000100:00100000:2.0:1776191170.812192:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2989
00000100:00100000:2.0:1776191170.812198:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bd36ba63 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630869632:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191170.812230:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191170.812284:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bd36ba63 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630869632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (961us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191170.812291:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2989
00000100:00100000:1.0:1776191170.812379:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de02bb16 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630869632:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191171.580754:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191171.842726:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191171.842748:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be5463b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630869696:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191171.842845:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191171.843095:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630869696
00000100:00100000:1.0:1776191171.844624:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2990
00000100:00100000:1.0:1776191171.844886:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004a22f9ff pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630869696:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191171.844929:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191171.845020:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004a22f9ff pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630869696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 385us (2175us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191171.845028:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2990
00000100:00100000:0.0:1776191171.846307:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be5463b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630869696:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191172.602434:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191172.858190:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000138721a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630869760:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191172.858191:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776191172.858207:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009fbbc7a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630869824:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191172.858475:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191172.858595:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630869824
00000100:00080000:1.0:1776191172.858724:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191172.858728:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191172.858731:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191172.858736:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3705
00000100:00080000:1.0:1776191172.858738:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191172.858743:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191172.858780:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000048199cde x1862467630870272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191172.858795:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191172.858798:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191172.858799:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191172.858802:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3705
00000100:00080000:1.0:1776191172.858803:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191172.858806:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191172.858820:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000016f04c4f x1862467630870336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191172.858856:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1e9431d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630870080:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191172.859022:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191172.859062:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e30dc2ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630870464:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191172.859084:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191172.859101:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:1.0:1776191172.859106:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028c45c84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630869888:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191172.859132:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191172.859146:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fadf7139 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630870144:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191172.859167:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191172.859191:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630870080
00000100:00100000:1.0:1776191172.859217:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630870464
00000100:00100000:1.0:1776191172.859235:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4386
00000100:00100000:1.0:1776191172.859240:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be5463b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630870080:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191172.859284:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be5463b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630870080:12345-0@lo:400:kworker/u8:4.0 Request processed in 44us (263us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191172.859468:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4386
00000100:00100000:1.0:1776191172.859486:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4387
00000100:00100000:1.0:1776191172.859491:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad5119bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630870464:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191172.859521:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad5119bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630870464:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (437us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191172.859526:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4387
00000100:00100000:1.0:1776191172.859547:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630870144
00000100:00100000:1.0:1776191172.859571:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2991
00000100:00100000:1.0:1776191172.859574:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000fc0c826 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630870144:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191172.859601:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000fc0c826 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630870144:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (434us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191172.859606:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2991
00000100:00100000:1.0:1776191172.859649:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fadf7139 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630870144:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191172.859659:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1e9431d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630870080:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191172.859665:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e30dc2ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630870464:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191172.859727:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191172.859945:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630869760
00000100:00100000:0.0:1776191172.859960:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000102502dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630870016:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191172.859974:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1509
00000100:00100000:2.0:1776191172.859980:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001648d249 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630869824:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191172.859991:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00002000:00000024:2.0:1776191172.860004:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191172.860010:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087d9e22f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630870400:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191172.860060:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191172.860274:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1510
00000100:00100000:3.0:1776191172.860279:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc38b04d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630869760:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191172.860290:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191172.860345:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630870016
00000100:00100000:3.0:1776191172.860424:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc38b04d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630869760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 143us (698us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191172.860432:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1510
00000100:00100000:0.0:1776191172.860441:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000138721a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630869760:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191172.860455:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:3.0:1776191172.860460:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048199cde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630870272:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191172.860465:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007bec6be8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630869952:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191172.860507:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191172.860508:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191172.860534:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000016f04c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630870336:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191172.860538:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003bea0498 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630870208:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191172.860570:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191172.860590:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630870400
00000100:00100000:3.0:1776191172.860613:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630870272
00000100:00100000:0.0:1776191172.860622:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630869952
00000100:00100000:3.0:1776191172.860642:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630870336
00000100:00100000:0.0:1776191172.860649:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4388
00000100:00100000:0.0:1776191172.860654:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b048c733 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630870400:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191172.860667:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2176
00000100:00100000:3.0:1776191172.860672:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036b83f3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630870272:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191172.860695:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b048c733 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630870400:12345-0@lo:400:kworker/u8:4.0 Request processed in 40us (634us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191172.860702:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4388
00000100:00100000:0.0:1776191172.860714:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4389
00000100:00100000:0.0:1776191172.860717:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ab2d9127 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630869952:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191172.860745:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ab2d9127 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630869952:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (242us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191172.860751:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4389
00000100:00100000:0.0:1776191172.860787:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191172.860845:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2992
00000100:00100000:1.0:1776191172.860849:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f784fad4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630870016:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191172.860879:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f784fad4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630870016:12345-0@lo:400:kworker/u8:4.0 Request processed in 29us (889us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191172.860884:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2992
00000100:00100000:2.0:1776191172.860944:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001648d249 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630869824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 963us (2470us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191172.860952:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1509
00000100:00100000:2.0:1776191172.860986:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009fbbc7a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630869824:0@lo:13:osp-pre-0-0.0
00010000:02020000:3.0:1776191172.861809:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191172.862801:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000102502dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630870016:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191172.862819:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087d9e22f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630870400:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191172.862846:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007bec6be8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630869952:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191172.862919:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630869888
00000100:00100000:0.0:1776191172.862962:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1660
00000100:00100000:0.0:1776191172.862968:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b0b64a4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630869888:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191172.863018:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b0b64a4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630869888:12345-0@lo:400:kworker/u8:4.0 Request processed in 49us (3885us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191172.863049:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1660
00000100:00100000:0.0:1776191172.863116:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028c45c84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630869888:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191172.863152:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630870208
00000100:00100000:0.0:1776191172.863163:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2177
00000100:00100000:0.0:1776191172.863169:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000808245d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630870336:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191172.863187:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1926
00000100:00100000:1.0:1776191172.863192:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b65b7705 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630870208:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191172.863238:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b65b7705 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630870208:12345-0@lo:400:kworker/u8:4.0 Request processed in 45us (2451us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191172.863245:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1926
00010000:02020000:0.0:1776191172.863259:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191172.863279:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003bea0498 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630870208:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191172.863292:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000808245d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630870336:12345-0@lo:8:kworker/u8:4.0 Request processed in 123us (2722us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191172.863300:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2177
00000100:00080000:1.0:1776191172.863338:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191172.863353:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191172.863357:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048199cde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630870272:0@lo:8:kworker/u8:4.0
00000100:00080000:1.0:1776191172.863368:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191172.863371:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191172.863373:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000016f04c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630870336:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191172.863666:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036b83f3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630870272:12345-0@lo:8:kworker/u8:4.0 Request processed in 1193us (1363us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191172.863674:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2176
00010000:00010000:3.0:1776191173.626296:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191174.497295:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191174.497344:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191174.497377:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191174.497402:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191174.497433:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191174.497467:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613783744
00000100:00100000:2.0:1776191174.497509:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613783808
00000100:00100000:2.0:1776191174.497526:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1927
00000100:00100000:2.0:1776191174.497532:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000138721a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613783744:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191174.497602:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000138721a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613783744:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 68us (199us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191174.497610:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1927
00000100:00100000:1.0:1776191174.497613:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613783680
00000100:00100000:2.0:1776191174.497627:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2178
00000100:00100000:2.0:1776191174.497631:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de02bb16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613783808:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00000100:00100000:1.0:1776191174.497639:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613783616
00000100:00100000:1.0:1776191174.497667:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4390
00000100:00100000:1.0:1776191174.497671:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000819bd127 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613783680:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191174.497700:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000819bd127 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613783680:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 28us (357us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191174.497706:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4390
00000100:00100000:1.0:1776191174.497718:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4391
00000100:00100000:1.0:1776191174.497722:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ff9f217e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613783616:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00010000:02020000:2.0:1776191174.497747:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191174.497752:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ff9f217e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613783616:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 30us (376us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191174.497758:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4391
00000100:00100000:2.0:1776191174.497769:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de02bb16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613783808:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 138us (337us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191174.497775:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2178
00000100:00100000:3.0:1776191174.497944:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613783552
00000100:00100000:3.0:1776191174.497981:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1661
00000100:00100000:3.0:1776191174.497985:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085b2d193 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613783552:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191174.498108:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085b2d193 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613783552:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 122us (821us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191174.498115:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1661
00010000:00010000:0.0:1776191174.653197:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191175.675571:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191175.933025:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd341e03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630870528:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191175.933129:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191175.933196:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630870528
00000100:00100000:3.0:1776191175.933324:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2993
00000100:00100000:3.0:1776191175.933331:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016f04c4f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630870528:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191175.933364:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191175.933416:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016f04c4f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630870528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (289us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191175.933422:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2993
00000100:00100000:2.0:1776191175.933495:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd341e03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630870528:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191176.698396:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191176.954574:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048199cde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630870592:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191176.954646:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191176.955252:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630870592
00000100:00100000:3.0:1776191176.955298:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2994
00000100:00100000:3.0:1776191176.955305:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd9107bd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630870592:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191176.955337:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191176.955388:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd9107bd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630870592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (742us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191176.955395:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2994
00000100:00100000:0.0:1776191176.955436:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048199cde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630870592:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191177.722407:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191177.978483:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191177.978502:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a634854 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630870720:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191177.978558:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191177.978611:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630870720
00000100:00100000:0.0:1776191177.978658:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1511
00000100:00100000:0.0:1776191177.978664:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000348ababd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630870720:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191177.978690:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191177.978734:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000348ababd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630870720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (175us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191177.978741:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1511
00000100:00100000:1.0:1776191177.978791:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a634854 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630870720:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1776191177.979394:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191177.979399:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191177.979402:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191177.979407:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3710
00000100:00080000:3.0:1776191177.979410:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191177.979415:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191177.979433:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630870976:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191177.979434:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000751b578a x1862467630871104/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191177.979454:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191177.979458:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191177.979460:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1776191177.979461:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003b6ef48d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630870848:0@lo:400:kworker/u8:2.0
00000100:00080000:3.0:1776191177.979465:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3710
00000100:00080000:3.0:1776191177.979469:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191177.979473:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191177.979479:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191177.979490:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000002a49d837 x1862467630871168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191177.979503:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191177.979510:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:1.0:1776191177.979520:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a8c7923 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630870784:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191177.979536:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000751b578a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630871104:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191177.979537:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630871232:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191177.979552:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191177.979647:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c02746a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630870656:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191177.979914:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191177.979915:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191177.979947:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a49d837 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630871168:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191177.979972:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191177.980003:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630871104
00000100:00100000:3.0:1776191177.980027:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630871168
00000100:00100000:3.0:1776191177.980151:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2179
00000100:00100000:3.0:1776191177.980156:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000161dca59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630871104:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191177.980249:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191177.980290:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000161dca59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630871104:12345-0@lo:8:kworker/u8:2.0 Request processed in 133us (380us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191177.980297:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2179
00000100:00100000:3.0:1776191177.980311:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2180
00000100:00100000:3.0:1776191177.980315:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c82d865 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630871168:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191177.980379:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630870784
00000100:00100000:0.0:1776191177.980410:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630871232
00000100:00100000:0.0:1776191177.980429:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4392
00000100:00100000:0.0:1776191177.980433:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028c45c84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630870784:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191177.980472:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028c45c84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630870784:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (922us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191177.980478:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4392
00010000:02020000:3.0:1776191177.980481:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191177.980494:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4393
00000100:00100000:0.0:1776191177.980498:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa08bf51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630871232:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191177.980514:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c82d865 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630871168:12345-0@lo:8:kworker/u8:2.0 Request processed in 197us (541us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191177.980522:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2180
00000100:00100000:0.0:1776191177.980539:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa08bf51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630871232:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (629us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191177.980547:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4393
00000100:00100000:3.0:1776191177.980549:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630870976
00000100:00100000:3.0:1776191177.980577:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630870848
00000100:00100000:3.0:1776191177.980590:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2995
00000100:00100000:3.0:1776191177.980594:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003bea0498 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630870976:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191177.980623:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003bea0498 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630870976:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (1150us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191177.980628:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2995
00000100:00100000:3.0:1776191177.980639:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2996
00000100:00100000:3.0:1776191177.980642:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b2bebc0b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630870848:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191177.980681:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b2bebc0b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630870848:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (1180us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191177.980687:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2996
00000100:00100000:0.0:1776191177.980707:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630871232:0@lo:400:kworker/u8:2.0
00000100:00080000:3.0:1776191177.980722:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1776191177.980725:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003b6ef48d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630870848:0@lo:400:kworker/u8:2.0
00000100:00080000:3.0:1776191177.980728:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191177.980734:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000751b578a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630871104:0@lo:8:kworker/u8:2.0
00000100:00080000:3.0:1776191177.980750:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191177.980753:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191177.980756:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a49d837 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630871168:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191177.980854:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1776191177.980863:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a49d837 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630871360:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191177.980892:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191177.980912:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630871360
00000100:00100000:0.0:1776191177.980940:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1512
00000100:00100000:0.0:1776191177.980943:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000751b578a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630871360:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191177.981057:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191177.981187:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000751b578a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630871360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 242us (296us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191177.981194:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1512
00000100:00100000:2.0:1776191177.981412:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191177.981439:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a26e20f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630870912:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191177.981463:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191177.981479:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000418a6d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630871296:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191177.981502:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191177.981521:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a8c7923 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630870784:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191177.981531:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000099f3d8e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630871040:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191177.981535:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630870912
00000100:00100000:1.0:1776191177.981563:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191177.981586:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630870976:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191177.981611:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630871040
00000100:00100000:1.0:1776191177.981638:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1928
00000100:00100000:1.0:1776191177.981642:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007bec6be8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630871040:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191177.981692:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007bec6be8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630871040:12345-0@lo:400:kworker/u8:2.0 Request processed in 48us (129us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191177.981692:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630871296
00000100:00100000:1.0:1776191177.981700:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1928
00000100:00100000:2.0:1776191177.981724:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4394
00000100:00100000:2.0:1776191177.981729:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd341e03 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630870912:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191177.981735:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000099f3d8e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630871040:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191177.981773:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4395
00000100:00100000:2.0:1776191177.981775:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd341e03 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630870912:12345-0@lo:400:kworker/u8:2.0 Request processed in 42us (308us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191177.981781:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002200bdf2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630871296:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191177.981787:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4394
00000100:00100000:2.0:1776191177.981820:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a26e20f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630870912:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191177.981899:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630870656
00000100:00100000:0.0:1776191177.981932:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1662
00000100:00100000:0.0:1776191177.981936:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cef7ed6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630870656:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191177.982156:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cef7ed6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630870656:12345-0@lo:400:kworker/u8:2.0 Request processed in 218us (744us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191177.982164:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1662
00000100:00100000:3.0:1776191177.982388:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a49d837 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630871360:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191177.982455:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c02746a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630870656:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191177.982715:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002200bdf2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630871296:12345-0@lo:400:kworker/u8:2.0 Request processed in 934us (1213us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191177.982722:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4395
00000100:00100000:2.0:1776191177.983738:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000418a6d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630871296:0@lo:400:kworker/u8:2.0
00010000:00010000:3.0:1776191178.746268:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191179.613504:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191179.613570:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191179.613578:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613783936
00000100:00100000:0.0:1776191179.613673:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4396
00000100:00100000:0.0:1776191179.613680:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a0236b56 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613783936:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191179.614308:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a0236b56 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613783936:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 626us (810us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191179.614317:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4396
00000100:00100000:1.0:1776191179.616868:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613784064
00000100:00100000:1.0:1776191179.616939:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1929
00000100:00100000:1.0:1776191179.616946:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000903b74ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613784064:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191179.617453:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191179.617498:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191179.617530:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191179.617552:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613784128
00000100:00100000:2.0:1776191179.617580:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2181
00000100:00100000:2.0:1776191179.617584:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000011433d90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613784128:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:2.0:1776191179.617699:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191179.617737:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000011433d90 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613784128:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 151us (208us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191179.617744:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2181
00000100:00100000:2.0:1776191179.617785:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613784000
00000100:00100000:2.0:1776191179.617810:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4397
00000100:00100000:2.0:1776191179.617814:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f79865d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613784000:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191179.617842:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f79865d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613784000:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 27us (345us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191179.617848:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4397
00000100:00100000:3.0:1776191179.618308:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613783872
00000100:00100000:3.0:1776191179.618343:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1663
00000100:00100000:3.0:1776191179.618348:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000000cecea7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613783872:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191179.618378:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000000cecea7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613783872:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 30us (927us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191179.618385:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1663
00000100:00100000:1.0:1776191179.620764:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000903b74ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613784064:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 3809us (7186us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191179.620778:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1929
00010000:00010000:3.0:1776191179.770371:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191180.794195:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191181.051980:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1776191181.051995:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f1df7d70 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630871424:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191181.052076:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191181.052219:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630871424
00000100:00100000:0.0:1776191181.052270:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2997
00000100:00100000:0.0:1776191181.052275:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007bec6be8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630871424:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191181.052309:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191181.052359:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007bec6be8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630871424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (283us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191181.052367:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2997
00000100:00100000:1.0:1776191181.052448:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f1df7d70 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630871424:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191181.819462:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191182.074747:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1776191182.074768:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c4888416 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630871488:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191182.074830:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191182.078620:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630871488
00000100:00100000:3.0:1776191182.078881:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2998
00000100:00100000:3.0:1776191182.078889:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000553c7232 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630871488:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191182.078924:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191182.078998:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000553c7232 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630871488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (4168us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191182.079005:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2998
00000100:00100000:2.0:1776191182.079293:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c4888416 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630871488:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191182.842228:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191183.098303:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a49d837 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630871552:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191183.098365:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191183.098446:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630871552
00000100:00100000:3.0:1776191183.098498:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1513
00000100:00100000:3.0:1776191183.098503:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000087d9e22f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630871552:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191183.098531:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191183.098583:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000087d9e22f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630871552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (218us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191183.098590:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1513
00000100:00080000:0.0:1776191183.098861:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191183.098865:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191183.098869:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191183.098873:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3716
00000100:00080000:0.0:1776191183.098875:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191183.098879:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191183.098896:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000002e3e1154 x1862467630872000/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191183.098909:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191183.098912:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191183.098913:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191183.098916:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3716
00000100:00080000:0.0:1776191183.098918:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191183.098921:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191183.098930:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000c0b28322 x1862467630872064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191183.098959:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a98c80a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630871744:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191183.098988:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191183.099003:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000025f3deb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630872128:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191183.099025:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191183.099150:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000085e6ba1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630871616:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191183.099179:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191183.099194:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a2c32111 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630871872:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191183.099211:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191183.099229:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:3.0:1776191183.099233:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f485f4a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630871680:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191183.099256:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002e3e1154 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630872000:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191183.099277:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191183.099290:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0b28322 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630872064:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191183.099307:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191183.099330:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630871744
00000100:00100000:3.0:1776191183.099353:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630871872
00000100:00100000:3.0:1776191183.099364:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2999
00000100:00100000:3.0:1776191183.099369:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7cf3eab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630871744:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191183.099401:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7cf3eab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630871744:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (413us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191183.099408:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2999
00000100:00100000:3.0:1776191183.099431:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3000
00000100:00100000:3.0:1776191183.099435:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009189961c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630871872:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191183.099465:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009189961c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630871872:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (253us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191183.099471:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3000
00000100:00100000:0.0:1776191183.099724:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a98c80a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630871744:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191183.099740:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:0.0:1776191183.099747:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009273e03a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630871808:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191183.099750:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630871616
00000100:00100000:0.0:1776191183.099776:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191183.099783:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1664
00000100:00100000:0.0:1776191183.099828:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a79b73d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630872192:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191183.099850:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191183.099869:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630872128
00000100:00100000:3.0:1776191183.099896:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630871808
00000100:00100000:3.0:1776191183.099911:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4398
00000100:00100000:3.0:1776191183.099915:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e00c592 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630872128:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191183.099947:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e00c592 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630872128:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (922us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191183.099953:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4398
00000100:00100000:3.0:1776191183.099964:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4399
00000100:00100000:3.0:1776191183.099968:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a98c80a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630871808:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191183.099990:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a98c80a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630871808:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (216us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191183.099995:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4399
00000100:00100000:3.0:1776191183.100008:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1776191183.100016:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c4888416 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630872256:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191183.100158:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000025f3deb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630872128:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191183.100175:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009273e03a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630871808:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191183.100179:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e23389f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630871616:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191183.100195:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191183.100213:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1da7374 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630871936:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191183.100226:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e23389f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630871616:12345-0@lo:400:kworker/u8:2.0 Request processed in 50us (1045us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191183.100234:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1664
00000100:00100000:0.0:1776191183.100241:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191183.100265:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000085e6ba1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630871616:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191183.100274:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630872000
00000100:00100000:0.0:1776191183.100278:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a2c32111 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630871872:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191183.100301:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630872064
00000100:00100000:0.0:1776191183.100310:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630872192
00000100:00100000:2.0:1776191183.100319:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630871936
00000100:00100000:0.0:1776191183.100338:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630871680
00000100:00100000:2.0:1776191183.100350:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1930
00000100:00100000:2.0:1776191183.100355:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000025f3deb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630871936:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191183.100364:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4400
00000100:00100000:0.0:1776191183.100369:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cbd36cc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630872192:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191183.100397:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000025f3deb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630871936:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (158us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191183.100405:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1930
00000100:00100000:0.0:1776191183.100416:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cbd36cc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630872192:12345-0@lo:400:kworker/u8:2.0 Request processed in 45us (565us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191183.100434:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2182
00000100:00100000:0.0:1776191183.100437:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4400
00000100:00100000:2.0:1776191183.100442:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008cc360bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630872000:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191183.100454:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4401
00000100:00100000:0.0:1776191183.100459:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009273e03a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630871680:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191183.100485:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009273e03a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630871680:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (291us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191183.100494:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4401
00000100:00100000:0.0:1776191183.100520:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a79b73d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630872192:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191183.100584:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2183
00000100:00100000:0.0:1776191183.100588:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f22abe6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630872064:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191183.100671:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191183.100705:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f22abe6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630872064:12345-0@lo:8:kworker/u8:2.0 Request processed in 116us (1398us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191183.100710:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2183
00000100:00080000:0.0:1776191183.100738:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191183.100741:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191183.100744:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0b28322 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630872064:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191183.100770:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f485f4a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630871680:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191183.100779:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1da7374 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630871936:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191183.100853:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191183.101137:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630872256
00000100:00100000:0.0:1776191183.101206:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1514
00000100:00100000:0.0:1776191183.101210:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eae49c12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630872256:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191183.101225:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191183.101263:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eae49c12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630872256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (411us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191183.101268:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1514
00000100:00100000:3.0:1776191183.101325:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c4888416 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630872256:0@lo:13:osp-pre-0-1.0
00010000:02020000:2.0:1776191183.101464:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191183.101500:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008cc360bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630872000:12345-0@lo:8:kworker/u8:2.0 Request processed in 1059us (2222us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191183.101508:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2182
00000100:00080000:2.0:1776191183.101532:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191183.101536:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191183.101552:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002e3e1154 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630872000:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191183.103670:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a49d837 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630871552:0@lo:13:osp-pre-0-0.0
00010000:00010000:0.0:1776191183.866504:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191184.732416:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191184.732461:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191184.732490:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191184.732542:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191184.732569:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613784192
00000100:00100000:2.0:1776191184.732570:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191184.732614:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1665
00000100:00100000:0.0:1776191184.732621:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4da44d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613784192:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191184.732760:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613784256
00000100:00100000:1.0:1776191184.732798:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613784320
00000100:00100000:1.0:1776191184.732817:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4402
00000100:00100000:1.0:1776191184.732821:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008b059045 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613784256:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191184.732904:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4403
00000100:00100000:3.0:1776191184.732911:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b866e7b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613784320:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191184.733084:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4da44d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613784192:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 462us (676us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191184.733093:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1665
00000100:00100000:1.0:1776191184.733103:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008b059045 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613784256:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 279us (640us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191184.733112:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4402
00000100:00100000:0.0:1776191184.733160:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613784384
00000100:00100000:0.0:1776191184.733191:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613784448
00000100:00100000:0.0:1776191184.733206:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1931
00000100:00100000:0.0:1776191184.733210:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000022db519c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613784384:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191184.733244:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000022db519c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613784384:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 23us (693us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191184.733251:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1931
00000100:00100000:0.0:1776191184.733267:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2184
00000100:00100000:0.0:1776191184.733271:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001ea1acb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613784448:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:0.0:1776191184.733370:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191184.733390:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001ea1acb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613784448:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 119us (822us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191184.733396:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2184
00000100:00100000:3.0:1776191184.739977:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b866e7b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613784320:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 7058us (7479us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191184.740003:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4403
00010000:00010000:3.0:1776191184.890226:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191185.915020:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191186.170886:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191186.170901:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c4fd0f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630872320:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191186.170960:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191186.171108:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630872320
00000100:00100000:1.0:1776191186.171193:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3001
00000100:00100000:1.0:1776191186.171200:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a1da7374 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630872320:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191186.171232:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191186.171285:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a1da7374 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630872320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (325us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191186.171291:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3001
00000100:00100000:0.0:1776191186.171356:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c4fd0f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630872320:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191186.938788:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191187.194436:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000097f506b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630872384:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191187.194519:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191187.194611:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630872384
00000100:00100000:2.0:1776191187.194661:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3002
00000100:00100000:2.0:1776191187.194668:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f485f4a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630872384:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191187.194701:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191187.194759:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f485f4a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630872384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (240us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191187.194766:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3002
00000100:00100000:0.0:1776191187.195075:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000097f506b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630872384:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191187.962424:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1776191188.218386:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191188.218393:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191188.218396:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191188.218405:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3721
00000100:00080000:1.0:1776191188.218408:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191188.218414:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191188.218532:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000001abea6d8 x1862467630872896/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191188.218548:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191188.218551:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191188.218552:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191188.218555:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3721
00000100:00080000:1.0:1776191188.218557:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191188.218560:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191188.218571:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000087950b98 x1862467630872960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191188.219314:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000102502dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630872448:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191188.219385:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191188.219442:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fadf7139 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630872704:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191188.219453:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001abea6d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630872896:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191188.219471:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191188.219494:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5f2099 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630873088:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191188.219498:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191188.219521:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087950b98 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630872960:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191188.219528:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191188.219556:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191188.219561:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:0.0:1776191188.219569:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1e9431d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630872640:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191188.219599:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191188.219607:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630872704
00000100:00100000:0.0:1776191188.219619:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c6718b89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630873024:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191188.219644:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630872896
00000100:00100000:0.0:1776191188.219647:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191188.219653:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3003
00000100:00100000:2.0:1776191188.219660:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b28322 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630872704:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191188.219673:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630872960
00000100:00100000:0.0:1776191188.219688:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630873088
00000100:00100000:3.0:1776191188.219695:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2185
00000100:00100000:3.0:1776191188.219700:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000719a2127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630872896:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191188.219716:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b28322 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630872704:12345-0@lo:400:kworker/u8:4.0 Request processed in 55us (244us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191188.219720:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630872640
00000100:00100000:2.0:1776191188.219725:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3003
00000100:00100000:0.0:1776191188.219747:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630873024
00000100:00100000:2.0:1776191188.219757:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2186
00000100:00100000:2.0:1776191188.219762:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000013b80f08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630872960:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191188.219769:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4404
00000100:00100000:0.0:1776191188.219773:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004a79b73d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630873088:12345-0@lo:400:kworker/u8:4.0
00010000:02020000:3.0:1776191188.219801:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191188.219807:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004a79b73d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630873088:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (281us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191188.219813:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4404
00000100:00100000:0.0:1776191188.219830:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4405
00000100:00100000:0.0:1776191188.219834:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2c32111 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630872640:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191188.219844:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000719a2127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630872896:12345-0@lo:8:kworker/u8:4.0 Request processed in 143us (350us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191188.219851:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2185
00000100:00100000:0.0:1776191188.219869:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2c32111 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630872640:12345-0@lo:400:kworker/u8:4.0 Request processed in 34us (270us total) trans 0 rc 0/0
00010000:02020000:2.0:1776191188.219877:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191188.219879:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4405
00000100:00080000:3.0:1776191188.219894:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1776191188.219896:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4406
00000100:00080000:3.0:1776191188.219901:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191188.219905:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000085e6ba1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630873024:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191188.219909:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001abea6d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630872896:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191188.219914:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000013b80f08 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630872960:12345-0@lo:8:kworker/u8:4.0 Request processed in 148us (357us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191188.219923:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2186
00000100:00080000:3.0:1776191188.219926:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191188.219930:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191188.219934:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087950b98 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630872960:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191188.219944:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000085e6ba1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630873024:12345-0@lo:400:kworker/u8:4.0 Request processed in 39us (298us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191188.219952:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4406
00000100:00100000:2.0:1776191188.219955:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009fbbc7a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630872512:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191188.219971:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e30dc2ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630872576:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191188.219988:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191188.220003:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191188.220020:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c904ec5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630872832:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191188.220052:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191188.220064:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000df87de4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630873216:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191188.220080:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191188.220109:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630873216
00000100:00100000:1.0:1776191188.220130:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630872448
00000100:00100000:3.0:1776191188.220137:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1515
00000100:00100000:3.0:1776191188.220141:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002a49d837 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630873216:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191188.220161:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191188.220205:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002a49d837 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630873216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (124us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191188.220211:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1515
00000100:00100000:3.0:1776191188.220229:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630872576
00000100:00100000:3.0:1776191188.220249:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3004
00000100:00100000:3.0:1776191188.220253:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000005f434a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630872576:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191188.220279:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000005f434a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630872576:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (277us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191188.220285:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3004
00000100:00100000:3.0:1776191188.220304:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630872832
00000100:00100000:3.0:1776191188.220320:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1932
00000100:00100000:3.0:1776191188.220323:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f76e3cf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630872832:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191188.220346:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f76e3cf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630872832:12345-0@lo:400:kworker/u8:4.0 Request processed in 22us (294us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191188.220351:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1932
00000100:00100000:3.0:1776191188.220374:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e30dc2ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630872576:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191188.220382:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c904ec5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630872832:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191188.220392:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000df87de4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630873216:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191188.220599:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1e9431d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630872640:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191188.220609:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c6718b89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630873024:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191188.220618:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fadf7139 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630872704:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191188.220626:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5f2099 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630873088:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191188.220684:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1666
00000100:00100000:1.0:1776191188.220689:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e54e7edc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630872448:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191188.220728:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e54e7edc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630872448:12345-0@lo:400:kworker/u8:4.0 Request processed in 38us (1343us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191188.220734:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1666
00000100:00100000:1.0:1776191188.220767:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000102502dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630872448:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191188.226634:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048199cde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630872768:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191188.226695:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191188.226721:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009df06d88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630873152:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191188.226741:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191188.226788:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630873152
00000100:00100000:2.0:1776191188.226834:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1516
00000100:00100000:2.0:1776191188.226840:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a23f3206 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630873152:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191188.226866:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191188.227112:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a23f3206 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630873152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 271us (369us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191188.227119:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1516
00000100:00100000:2.0:1776191188.227236:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009df06d88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630873152:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191188.227276:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630872768
00000100:00100000:2.0:1776191188.227299:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1933
00000100:00100000:2.0:1776191188.227303:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae36b234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630872768:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191188.227436:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae36b234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630872768:12345-0@lo:400:kworker/u8:4.0 Request processed in 123us (733us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191188.227444:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1933
00000100:00100000:2.0:1776191188.227473:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048199cde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630872768:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191188.231626:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630872512
00000100:00100000:3.0:1776191188.231706:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4407
00000100:00100000:3.0:1776191188.231712:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d23ef891 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630872512:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191188.231976:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009fbbc7a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630872512:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191188.234665:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d23ef891 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630872512:12345-0@lo:400:kworker/u8:4.0 Request processed in 99us (11826us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191188.234680:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4407
00010000:00010000:3.0:1776191188.986628:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191189.853015:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191189.853130:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191189.853167:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191189.853270:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613784704
00000100:00100000:0.0:1776191189.853323:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1934
00000100:00100000:0.0:1776191189.853329:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a11d1076 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613784704:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191189.853418:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a11d1076 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613784704:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 88us (288us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191189.853425:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1934
00000100:00100000:1.0:1776191189.853616:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613784576
00000100:00100000:1.0:1776191189.853649:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4408
00000100:00100000:1.0:1776191189.853653:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004d203170 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613784576:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191189.853695:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004d203170 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613784576:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 40us (689us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191189.853709:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4408
00000100:00100000:2.0:1776191189.853854:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191189.853886:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191189.854841:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613784640
00000100:00100000:1.0:1776191189.854901:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4409
00000100:00100000:1.0:1776191189.854906:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f4b1b7aa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613784640:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191189.854960:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f4b1b7aa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613784640:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 53us (1107us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191189.854967:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4409
00000100:00100000:0.0:1776191189.855444:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613784768
00000100:00100000:0.0:1776191189.855493:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2187
00000100:00100000:0.0:1776191189.855498:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005693775e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613784768:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:0.0:1776191189.855613:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191189.855672:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005693775e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613784768:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 172us (1785us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191189.855680:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2187
00000100:00100000:3.0:1776191189.859121:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613784512
00000100:00100000:3.0:1776191189.859186:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1667
00000100:00100000:3.0:1776191189.859193:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f9ea876 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613784512:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191189.859272:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f9ea876 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613784512:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 79us (6105us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191189.859280:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1667
00010000:00010000:0.0:1776191190.010303:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191191.034230:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191191.293019:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b4fccb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630873280:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191191.293112:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191191.293195:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630873280
00000100:00100000:3.0:1776191191.293307:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3005
00000100:00100000:3.0:1776191191.293314:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eb81ae79 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630873280:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191191.293352:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191191.293419:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eb81ae79 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630873280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (307us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191191.293426:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3005
00000100:00100000:1.0:1776191191.293501:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b4fccb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630873280:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191192.059440:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191192.314945:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000234e2cfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630873344:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191192.315027:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191192.328309:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630873344
00000100:00100000:0.0:1776191192.328824:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3006
00000100:00100000:0.0:1776191192.328831:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5f2099 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630873344:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191192.328866:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191192.329032:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5f2099 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630873344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 200us (14004us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191192.329056:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3006
00000100:00100000:2.0:1776191192.336079:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000234e2cfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630873344:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191193.082711:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1776191193.341663:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191193.341670:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191193.341673:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191193.341680:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3726
00000100:00080000:0.0:1776191193.341684:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191193.341689:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191193.341709:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000041c7ca25 x1862467630873920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191193.341728:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191193.341731:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191193.341732:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191193.341735:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3726
00000100:00080000:0.0:1776191193.341737:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191193.341740:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191193.341750:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000f43f1e37 x1862467630873984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191193.341785:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000041c7ca25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630873920:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191193.341842:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191193.341870:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f43f1e37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630873984:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191193.341890:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191193.341925:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630873920
00000100:00100000:0.0:1776191193.341950:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630873984
00000100:00100000:0.0:1776191193.341965:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2188
00000100:00100000:0.0:1776191193.341970:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ee2fc84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630873920:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191193.342084:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191193.342120:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ee2fc84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630873920:12345-0@lo:8:kworker/u8:2.0 Request processed in 149us (278us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191193.342127:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2188
00000100:00100000:0.0:1776191193.342143:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2189
00000100:00100000:0.0:1776191193.342145:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000069c1692e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630873984:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191193.342224:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191193.342245:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000069c1692e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630873984:12345-0@lo:8:kworker/u8:2.0 Request processed in 99us (355us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191193.342251:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2189
00000100:00080000:0.0:1776191193.342282:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191193.342285:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191193.342288:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000041c7ca25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630873920:0@lo:8:kworker/u8:2.0
00000100:00080000:0.0:1776191193.342296:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191193.342298:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191193.342300:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f43f1e37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630873984:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191193.344421:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028296d2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630873472:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191193.344489:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191193.344514:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630873728:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191193.344541:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191193.344558:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000746b7981 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630874112:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191193.344584:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191193.344605:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [2->3]
00000100:00100000:3.0:1776191193.344611:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006eae40ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630873408:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191193.344635:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191193.344648:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a634854 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630873664:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191193.344667:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191193.344683:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ab7db222 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630874048:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191193.344702:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191193.344747:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630874112
00000100:00100000:3.0:1776191193.344781:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630873664
00000100:00100000:3.0:1776191193.344801:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630874048
00000100:00100000:3.0:1776191193.344818:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4410
00000100:00100000:3.0:1776191193.344823:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008790082b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630874112:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191193.344868:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008790082b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630874112:12345-0@lo:400:kworker/u8:2.0 Request processed in 45us (284us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191193.344876:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4410
00000100:00100000:3.0:1776191193.344889:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4411
00000100:00100000:3.0:1776191193.344893:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000808245d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630873664:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191193.344917:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000808245d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630873664:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (250us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191193.344923:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4411
00000100:00100000:3.0:1776191193.344933:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4412
00000100:00100000:3.0:1776191193.344937:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036b83f3c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630874048:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191193.344960:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036b83f3c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630874048:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (258us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191193.344965:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4412
00000100:00100000:3.0:1776191193.344986:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630873728
00000100:00100000:3.0:1776191193.345006:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3007
00000100:00100000:3.0:1776191193.345009:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df87de4e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630873728:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191193.345059:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df87de4e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630873728:12345-0@lo:400:kworker/u8:2.0 Request processed in 48us (518us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191193.345064:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3007
00000100:00100000:3.0:1776191193.345095:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a634854 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630873664:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191193.345105:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ab7db222 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630874048:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191193.345112:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630873728:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191193.345120:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000746b7981 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630874112:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191193.346472:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002e3e1154 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630873536:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191193.346527:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191193.346557:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d8a67d69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630873792:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191193.346581:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191193.346606:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:1.0:1776191193.346612:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b65b7705 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630873600:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191193.346634:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191193.346654:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006776e411 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630873856:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191193.346674:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191193.346706:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630873472
00000100:00100000:1.0:1776191193.346742:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1668
00000100:00100000:1.0:1776191193.346747:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000653a1d11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630873472:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191193.346787:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000653a1d11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630873472:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (2299us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191193.346794:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1668
00000100:00100000:1.0:1776191193.346824:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630873408
00000100:00100000:1.0:1776191193.346845:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1517
00000100:00100000:1.0:1776191193.346849:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bff87142 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630873408:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191193.346870:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191193.346896:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bff87142 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630873408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (2262us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191193.346902:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1517
00000100:00100000:1.0:1776191193.347125:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630873536
00000100:00100000:1.0:1776191193.347152:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4413
00000100:00100000:1.0:1776191193.347156:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000421d4a36 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630873536:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191193.347191:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000421d4a36 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630873536:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (664us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191193.347197:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4413
00000100:00100000:1.0:1776191193.347216:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630873600
00000100:00100000:1.0:1776191193.347235:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3008
00000100:00100000:1.0:1776191193.347238:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000138721a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630873600:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191193.347267:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000138721a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630873600:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (633us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191193.347273:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3008
00000100:00100000:1.0:1776191193.347297:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630873792
00000100:00100000:1.0:1776191193.347315:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630873856
00000100:00100000:0.0:1776191193.350464:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1935
00000100:00100000:0.0:1776191193.350476:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006821defb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630873792:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191193.350563:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006821defb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630873792:12345-0@lo:400:kworker/u8:2.0 Request processed in 88us (3982us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191193.350571:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1935
00000100:00100000:0.0:1776191193.350725:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b65b7705 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630873600:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191193.350740:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002e3e1154 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630873536:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191193.350750:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d8a67d69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630873792:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191193.352807:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006eae40ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630873408:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191193.352823:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028296d2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630873472:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191193.352897:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002d7eb8c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630874176:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191193.352945:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191193.353003:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630874176
00000100:00100000:3.0:1776191193.353054:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1518
00000100:00100000:3.0:1776191193.353060:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000234e2cfd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630874176:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191193.353078:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191193.353520:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1936
00000100:00100000:1.0:1776191193.353525:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de02bb16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630873856:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191193.354667:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000234e2cfd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630874176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1603us (1718us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191193.354681:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1518
00000100:00100000:1.0:1776191193.354778:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de02bb16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630873856:12345-0@lo:400:kworker/u8:2.0 Request processed in 1252us (8103us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191193.354786:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1936
00000100:00100000:2.0:1776191193.356703:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002d7eb8c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630874176:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191193.356725:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006776e411 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630873856:0@lo:400:kworker/u8:2.0
00010000:00010000:3.0:1776191194.106589:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191194.971529:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191194.971573:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191194.971611:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191194.971650:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191194.971702:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613784960
00000100:00100000:1.0:1776191194.971713:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191194.971746:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4414
00000100:00100000:0.0:1776191194.971752:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008ef4d77e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613784960:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191194.971756:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613785088
00000100:00100000:0.0:1776191194.971775:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613784896
00000100:00100000:1.0:1776191194.971779:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613785024
00000100:00100000:0.0:1776191194.971795:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4415
00000100:00100000:1.0:1776191194.971797:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1937
00000100:00100000:0.0:1776191194.971799:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2c7adec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613784896:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191194.971801:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006eae40ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613785024:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191194.971886:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613784832
00000100:00100000:2.0:1776191194.971913:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1669
00000100:00100000:2.0:1776191194.971917:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd6c2b01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613784832:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191194.971982:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2190
00000100:00100000:3.0:1776191194.971987:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ff6c3c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613785088:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:3.0:1776191194.972107:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191194.972196:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2c7adec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613784896:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 396us (546us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191194.972205:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4415
00000100:00100000:1.0:1776191194.987392:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006eae40ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613785024:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 15574us (15663us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191194.987407:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1937
00000100:00100000:1.0:1776191194.987563:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008ef4d77e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613784960:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 15810us (15952us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191194.987572:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4414
00000100:00100000:2.0:1776191195.000795:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd6c2b01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613784832:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 28868us (29213us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191195.000811:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1669
00000100:00100000:3.0:1776191195.007835:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ff6c3c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613785088:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 35840us (36318us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191195.007850:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2190
00010000:00010000:3.0:1776191195.130936:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191196.154357:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191196.417633:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000063d0eb65 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630874240:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191196.417715:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191196.419827:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630874240
00000100:00100000:1.0:1776191196.419887:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3009
00000100:00100000:1.0:1776191196.419892:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000161dca59 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630874240:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191196.419924:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191196.419982:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000161dca59 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630874240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (2268us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191196.419989:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3009
00000100:00100000:3.0:1776191196.420792:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000063d0eb65 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630874240:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191197.178914:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191197.434495:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1776191197.434515:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fd189403 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630874304:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191197.434593:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191197.434733:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630874304
00000100:00100000:1.0:1776191197.434774:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3010
00000100:00100000:1.0:1776191197.434779:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c82d865 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630874304:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191197.434808:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191197.434851:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c82d865 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630874304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (266us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191197.434858:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3010
00000100:00100000:3.0:1776191197.435544:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fd189403 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630874304:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191198.202330:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1776191198.458610:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191198.458617:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191198.458621:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191198.458629:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3731
00000100:00080000:3.0:1776191198.458632:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191198.458638:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191198.458654:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000940c739a x1862467630874816/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191198.458667:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191198.458669:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191198.458671:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191198.458673:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3731
00000100:00080000:3.0:1776191198.458675:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191198.458677:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191198.458695:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000c4fb1a2d x1862467630874880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191198.458727:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000099f3d8e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630874560:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191198.458785:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191198.458811:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000751b578a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630874944:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191198.458828:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191198.458842:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [3->2]
00000100:00100000:3.0:1776191198.458846:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000418a6d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630874368:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191198.458869:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191198.458880:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630874624:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191198.458910:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191198.458921:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eae49c12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630875008:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191198.458946:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191198.458965:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c02746a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630874432:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191198.459003:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191198.459015:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a8c7923 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630874688:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191198.459052:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191198.459065:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:3.0:1776191198.459069:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a26e20f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630874496:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191198.459086:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191198.459097:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003b6ef48d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630874752:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191198.459111:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191198.459135:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630874560
00000100:00100000:3.0:1776191198.459165:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630874944
00000100:00100000:3.0:1776191198.459178:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630875008
00000100:00100000:3.0:1776191198.459203:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630874432
00000100:00100000:3.0:1776191198.459225:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4416
00000100:00100000:3.0:1776191198.459230:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002a49d837 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630874560:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191198.459604:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002a49d837 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630874560:12345-0@lo:400:kworker/u8:2.0 Request processed in 372us (818us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191198.459612:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4416
00000100:00100000:3.0:1776191198.459627:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4417
00000100:00100000:3.0:1776191198.459631:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009df06d88 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630874944:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191198.459654:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009df06d88 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630874944:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (826us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191198.459659:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4417
00000100:00100000:3.0:1776191198.459668:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4418
00000100:00100000:3.0:1776191198.459671:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002271bdf7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630875008:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191198.459844:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630874624
00000100:00100000:2.0:1776191198.459865:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630874496
00000100:00100000:2.0:1776191198.459874:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3011
00000100:00100000:2.0:1776191198.459877:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a8e91aa5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630874624:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191198.459922:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a8e91aa5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630874624:12345-0@lo:400:kworker/u8:2.0 Request processed in 44us (1023us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191198.459928:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3011
00000100:00100000:2.0:1776191198.459945:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3012
00000100:00100000:2.0:1776191198.459948:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ab7db222 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630874496:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191198.459968:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ab7db222 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630874496:12345-0@lo:400:kworker/u8:2.0 Request processed in 20us (882us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191198.459974:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3012
00000100:00100000:2.0:1776191198.459989:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057bf8c54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630875072:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191198.460010:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191198.460060:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a26e20f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630874496:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191198.460084:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630875072
00000100:00100000:2.0:1776191198.460104:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1519
00000100:00100000:2.0:1776191198.460108:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000beb7750b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630875072:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191198.460129:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191198.460156:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000beb7750b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630875072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (146us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191198.460162:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1519
00000100:00100000:2.0:1776191198.460204:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057bf8c54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630875072:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191198.460235:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630874688
00000100:00100000:2.0:1776191198.460252:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630874752
00000100:00100000:2.0:1776191198.460607:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1938
00000100:00100000:2.0:1776191198.460612:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000059d0f50d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630874688:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191198.460645:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000059d0f50d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630874688:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (1594us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191198.460651:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1938
00000100:00100000:2.0:1776191198.460670:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a8c7923 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630874688:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191198.460696:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1939
00000100:00100000:2.0:1776191198.460699:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028296d2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630874752:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191198.460726:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028296d2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630874752:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (1614us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191198.460731:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1939
00000100:00100000:2.0:1776191198.460748:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003b6ef48d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630874752:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191198.460784:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630874368
00000100:00100000:2.0:1776191198.460803:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1670
00000100:00100000:2.0:1776191198.460806:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000040bbf344 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630874368:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191198.460830:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000040bbf344 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630874368:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (1961us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191198.460839:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1670
00000100:00100000:2.0:1776191198.460867:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4419
00000100:00100000:2.0:1776191198.460871:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006c69c74b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630874432:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191198.460896:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006c69c74b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630874432:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (1893us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191198.461121:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630874816:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191198.461150:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191198.461165:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c4fb1a2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630874880:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191198.461192:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191198.461235:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630874816
00000100:00100000:0.0:1776191198.461253:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630874880
00000100:00100000:0.0:1776191198.461272:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2191
00000100:00100000:0.0:1776191198.461275:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e63aab7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630874816:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191198.461371:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191198.461399:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e63aab7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630874816:12345-0@lo:8:kworker/u8:2.0 Request processed in 123us (250us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191198.461405:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2191
00000100:00100000:0.0:1776191198.461415:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2192
00000100:00100000:0.0:1776191198.461418:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029e81afd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630874880:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191198.461500:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191198.461518:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029e81afd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630874880:12345-0@lo:8:kworker/u8:2.0 Request processed in 99us (336us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191198.461523:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2192
00000100:00080000:0.0:1776191198.461546:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191198.461549:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191198.461552:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630874816:0@lo:8:kworker/u8:2.0
00000100:00080000:0.0:1776191198.461559:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191198.461561:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191198.461563:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c4fb1a2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630874880:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191198.461598:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c02746a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630874432:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191198.461621:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000418a6d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630874368:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191198.461630:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630874624:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191198.461641:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000099f3d8e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630874560:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191198.461650:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000751b578a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630874944:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191198.462059:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4419
00000100:00100000:3.0:1776191198.462420:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002271bdf7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630875008:12345-0@lo:400:kworker/u8:2.0 Request processed in 2746us (3472us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191198.462427:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4418
00000100:00100000:1.0:1776191198.464010:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191198.464026:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000567d6097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630875136:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191198.464090:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191198.464130:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630875136
00000100:00100000:1.0:1776191198.464162:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1520
00000100:00100000:1.0:1776191198.464167:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000051374a14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630875136:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191198.464197:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191198.464242:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000051374a14 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630875136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (152us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191198.464248:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1520
00000100:00100000:1.0:1776191198.464537:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000567d6097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630875136:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191198.465101:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eae49c12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630875008:0@lo:400:kworker/u8:2.0
00010000:00010000:3.0:1776191199.226372:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191200.095394:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191200.095444:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191200.095487:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191200.095522:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191200.095550:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191200.095587:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613785216
00000100:00100000:2.0:1776191200.095634:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613785280
00000100:00100000:2.0:1776191200.095662:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4420
00000100:00100000:2.0:1776191200.095668:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000057bf8c54 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613785216:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191200.095734:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613785344
00000100:00100000:2.0:1776191200.095746:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000057bf8c54 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613785216:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 76us (301us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191200.095754:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4420
00000100:00100000:0.0:1776191200.095768:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613785408
00000100:00100000:2.0:1776191200.095776:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4421
00000100:00100000:2.0:1776191200.095781:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000063d0eb65 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613785280:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191200.095789:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1940
00000100:00100000:0.0:1776191200.095795:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd189403 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613785344:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191200.095808:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000063d0eb65 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613785280:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 25us (286us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191200.095816:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4421
00000100:00100000:0.0:1776191200.095836:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd189403 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613785344:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 39us (348us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191200.095842:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2193
00000100:00100000:2.0:1776191200.095848:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a23f3206 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613785408:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00000100:00100000:1.0:1776191200.095894:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613785152
00000100:00100000:1.0:1776191200.095923:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1671
00000100:00100000:1.0:1776191200.095927:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bbf84eea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613785152:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191200.095952:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bbf84eea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613785152:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 24us (568us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191200.095961:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1671
00010000:02020000:2.0:1776191200.096837:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191200.096920:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a23f3206 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613785408:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 1072us (1370us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191200.099525:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1940
00000100:00100000:2.0:1776191200.100788:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2193
00010000:00010000:3.0:1776191200.250782:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191201.274738:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191201.530431:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b4fccb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630875200:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191201.530497:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191201.531539:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630875200
00000100:00100000:1.0:1776191201.531596:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3013
00000100:00100000:1.0:1776191201.531602:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e3e1154 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630875200:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191201.531637:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191201.533715:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e3e1154 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630875200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2019us (3125us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191201.533727:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3013
00000100:00100000:3.0:1776191201.533815:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b4fccb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630875200:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191202.298975:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191202.554618:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000097f506b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630875264:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191202.554689:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191202.555253:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630875264
00000100:00100000:1.0:1776191202.555291:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3014
00000100:00100000:1.0:1776191202.555297:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000076ea9d35 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630875264:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191202.555328:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191202.555378:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000076ea9d35 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630875264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (690us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191202.555385:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3014
00000100:00100000:0.0:1776191202.555435:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000097f506b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630875264:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191203.323065:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191203.578247:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000567d6097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630875328:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191203.578314:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191203.578352:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191203.578358:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c4fd0f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630875392:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191203.578380:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191203.578413:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630875328
00000100:00100000:2.0:1776191203.578414:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630875392
00000100:00100000:1.0:1776191203.578460:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1521
00000100:00100000:1.0:1776191203.578466:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000080311080 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630875328:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191203.578496:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191203.578533:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000080311080 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630875328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (219us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191203.578540:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1521
00000100:00080000:3.0:1776191203.578554:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191203.578559:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191203.578562:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191203.578566:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3736
00000100:00080000:3.0:1776191203.578569:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191203.578573:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191203.578590:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000009b397ad6 x1862467630875776/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191203.578603:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc38b04d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630875520:0@lo:400:kworker/u8:4.0
00000100:00080000:3.0:1776191203.578605:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191203.578608:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191203.578609:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191203.578611:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3736
00000100:00080000:3.0:1776191203.578613:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191203.578615:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191203.578625:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000d20676ab x1862467630875840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191203.578631:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191203.578652:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0fd09fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630875904:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191203.578652:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a634854 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630875648:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191203.578671:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191203.578680:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b65b7705 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630875456:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191203.578696:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b397ad6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630875776:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191203.578707:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191203.578717:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191203.578721:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000b9cbeaa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630875712:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191203.586027:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1522
00000100:00100000:2.0:1776191203.586055:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be4c283a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630875392:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191203.586090:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191203.587262:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000348ababd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630875584:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191203.590678:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630875456
00000100:00100000:3.0:1776191203.590742:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1672
00000100:00100000:3.0:1776191203.590749:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000351c4067 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630875456:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191203.590839:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000351c4067 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630875456:12345-0@lo:400:kworker/u8:4.0 Request processed in 90us (12131us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191203.591183:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1672
00000100:00100000:3.0:1776191203.591296:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630875520
00000100:00100000:3.0:1776191203.591327:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630875904
00000100:00100000:3.0:1776191203.591347:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4422
00000100:00100000:3.0:1776191203.591351:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000062801b3d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630875520:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191203.591397:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000062801b3d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630875520:12345-0@lo:400:kworker/u8:4.0 Request processed in 45us (12765us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191203.591403:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4422
00000100:00100000:3.0:1776191203.591416:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4423
00000100:00100000:3.0:1776191203.591419:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000746b7981 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630875904:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191203.591446:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000746b7981 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630875904:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (12775us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191203.591452:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4423
00000100:00100000:3.0:1776191203.591472:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191203.591506:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630875648
00000100:00100000:3.0:1776191203.591526:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4424
00000100:00100000:3.0:1776191203.591529:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d55fd4e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630875648:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191203.591559:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d55fd4e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630875648:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (87us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191203.591565:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4424
00000100:00100000:3.0:1776191203.591597:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a634854 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630875648:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191203.591626:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191203.591655:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b65b7705 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630875456:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191203.591716:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630875712
00000100:00100000:3.0:1776191203.591740:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3015
00000100:00100000:3.0:1776191203.591743:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a1548b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630875712:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191203.594554:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a1548b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630875712:12345-0@lo:400:kworker/u8:4.0 Request processed in 2802us (2919us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191203.594568:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3015
00000100:00100000:3.0:1776191203.594646:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0fd09fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630875904:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191203.594660:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc38b04d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630875520:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191203.595548:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630875776
00000100:00100000:3.0:1776191203.595592:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2194
00000100:00100000:3.0:1776191203.595598:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002d7eb8c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630875776:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191203.595704:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191203.595761:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002d7eb8c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630875776:12345-0@lo:8:kworker/u8:4.0 Request processed in 163us (17044us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191203.595768:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2194
00000100:00100000:3.0:1776191203.595808:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000b9cbeaa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630875712:0@lo:400:kworker/u8:4.0
00000100:00080000:0.0:1776191203.597488:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191203.597495:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191203.597500:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b397ad6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630875776:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191203.597509:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d20676ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630875840:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191203.597563:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191203.597694:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630875840
00000100:00100000:3.0:1776191203.597734:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2195
00000100:00100000:3.0:1776191203.597739:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d5dde41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630875840:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191203.597795:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be4c283a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630875392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 11740us (19413us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191203.597806:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1522
00010000:02020000:3.0:1776191203.597836:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191203.597871:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191203.597874:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d5dde41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630875840:12345-0@lo:8:kworker/u8:4.0 Request processed in 135us (313us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191203.597881:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2195
00000100:00100000:1.0:1776191203.597899:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630875584
00000100:00100000:1.0:1776191203.597924:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3016
00000100:00100000:1.0:1776191203.597928:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b08e6b10 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630875584:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191203.597963:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b08e6b10 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630875584:12345-0@lo:400:kworker/u8:4.0 Request processed in 34us (92us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191203.597978:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3016
00000100:00100000:1.0:1776191203.597998:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a96a54e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630875968:0@lo:400:kworker/u8:4.0
00000100:00080000:0.0:1776191203.598015:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191203.598018:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191203.598021:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d20676ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630875840:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191203.598024:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191203.598072:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c4fd0f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630875392:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191203.598087:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000567d6097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630875328:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191203.598119:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000348ababd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630875584:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191203.598345:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630875968
00000100:00100000:3.0:1776191203.598385:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4425
00000100:00100000:3.0:1776191203.598388:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000055f4b7ff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630875968:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191203.598431:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000055f4b7ff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630875968:12345-0@lo:400:kworker/u8:4.0 Request processed in 41us (406us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191203.598436:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4425
00000100:00100000:1.0:1776191203.598532:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a96a54e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630875968:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191204.346479:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191205.212743:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191205.212826:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191205.212863:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191205.212897:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191205.212950:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613785472
00000100:00100000:1.0:1776191205.212992:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1673
00000100:00100000:1.0:1776191205.212998:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048ed839b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613785472:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191205.213101:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048ed839b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613785472:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 102us (237us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191205.213108:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1673
00000100:00100000:3.0:1776191205.216661:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613785664
00000100:00100000:3.0:1776191205.216734:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1941
00000100:00100000:3.0:1776191205.216740:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f1df7d70 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613785664:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191205.216807:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f1df7d70 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613785664:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 67us (3983us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191205.216814:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1941
00000100:00100000:0.0:1776191205.219020:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613785536
00000100:00100000:3.0:1776191205.219681:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613785600
00000100:00100000:3.0:1776191205.219746:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4426
00000100:00100000:3.0:1776191205.219753:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000903b74ca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613785600:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191205.219818:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000903b74ca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613785600:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 66us (6922us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191205.219826:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4426
00000100:00100000:0.0:1776191205.220133:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4427
00000100:00100000:0.0:1776191205.220138:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4888416 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613785536:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191205.220168:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4888416 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613785536:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 29us (7433us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191205.220175:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4427
00000100:00100000:1.0:1776191205.220427:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191205.221494:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613785728
00000100:00100000:3.0:1776191205.221538:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2196
00000100:00100000:3.0:1776191205.221543:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3653833 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613785728:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:3.0:1776191205.221651:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191205.221713:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3653833 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613785728:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 169us (1288us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191205.221721:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2196
00010000:00010000:3.0:1776191205.370414:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191206.397245:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191206.650541:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191206.650559:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c4fd0f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630876032:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191206.650622:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191206.650855:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630876032
00000100:00100000:2.0:1776191206.650918:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3017
00000100:00100000:2.0:1776191206.650923:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bed67ee8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630876032:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191206.650954:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191206.651003:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bed67ee8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630876032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (381us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191206.651010:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3017
00000100:00100000:1.0:1776191206.651075:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c4fd0f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630876032:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191207.419481:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191207.674834:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000097f506b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630876096:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191207.674903:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191207.674931:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630876096
00000100:00100000:0.0:1776191207.675104:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3018
00000100:00100000:0.0:1776191207.675126:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0fd09fc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630876096:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191207.675164:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191207.675250:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0fd09fc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630876096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (346us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191207.675258:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3018
00000100:00100000:3.0:1776191207.675274:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000097f506b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630876096:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191208.443681:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191208.698508:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f43f1e37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630876288:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191208.698582:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191208.698610:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191208.698616:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b4fccb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630876224:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191208.698640:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191208.698670:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630876288
00000100:00100000:3.0:1776191208.698707:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1674
00000100:00100000:1.0:1776191208.698711:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000155ae841 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630876160:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191208.698726:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000062c92fc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630876288:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191208.698755:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191208.698784:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000062c92fc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630876288:12345-0@lo:400:kworker/u8:4.0 Request processed in 68us (201us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191208.698793:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f43f1e37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630876288:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191208.698794:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1674
00000100:00100000:1.0:1776191208.698825:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630876224
00000100:00100000:2.0:1776191208.698830:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630876160
00000100:00100000:1.0:1776191208.698874:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1523
00000100:00100000:1.0:1776191208.698880:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dcd4c128 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630876224:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191208.698887:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1524
00000100:00100000:2.0:1776191208.698893:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000caebeb11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630876160:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191208.698905:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00002000:00000024:2.0:1776191208.698907:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191208.698944:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dcd4c128 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630876224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (302us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191208.698952:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1523
00000100:00100000:3.0:1776191208.698969:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b4fccb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630876224:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191208.699149:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000caebeb11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630876160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 256us (396us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191208.699157:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1524
00000100:00100000:1.0:1776191208.700126:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000155ae841 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630876160:0@lo:13:osp-pre-0-0.0
00000100:00080000:0.0:1776191208.707571:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191208.707578:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191208.707582:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191208.707590:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3741
00000100:00080000:0.0:1776191208.707593:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191208.707599:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191208.707618:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000005e2ce3f1 x1862467630876608/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191208.707634:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d8a67d69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630876480:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191208.707738:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f43f1e37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630876352:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191208.707928:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006776e411 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630876416:0@lo:400:kworker/u8:4.0
00000100:00080000:0.0:1776191208.707964:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191208.707968:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191208.707969:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191208.707973:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3741
00000100:00080000:0.0:1776191208.707974:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191208.707978:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191208.708000:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000009ec90674 x1862467630876672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191208.708059:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e2ce3f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630876608:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191208.711533:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191208.711592:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776191208.711603:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a8f703ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630876544:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191208.712027:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191208.712076:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000af393e55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630876736:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191208.712104:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191208.712122:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1776191208.712127:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000041c7ca25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630876800:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191208.712146:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191208.712293:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630876480
00000100:00100000:1.0:1776191208.712333:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630876352
00000100:00100000:1.0:1776191208.712347:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630876736
00000100:00100000:0.0:1776191208.712464:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191208.712490:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ec90674 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630876672:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191208.712510:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191208.712589:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630876800
00000100:00100000:3.0:1776191208.712594:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4428
00000100:00100000:3.0:1776191208.712601:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b4fccb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630876480:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191208.712607:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4429
00000100:00100000:1.0:1776191208.712613:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ecd900ea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630876352:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191208.712672:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ecd900ea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630876352:12345-0@lo:400:kworker/u8:4.0 Request processed in 58us (646us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191208.712678:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4429
00000100:00100000:1.0:1776191208.712693:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4430
00000100:00100000:1.0:1776191208.712702:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b92c4097 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630876736:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191208.712722:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b92c4097 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630876736:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (620us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191208.712727:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4430
00000100:00100000:1.0:1776191208.712735:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4431
00000100:00100000:1.0:1776191208.712738:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a96a54e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630876800:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191208.712756:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a96a54e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630876800:12345-0@lo:400:kworker/u8:4.0 Request processed in 17us (611us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191208.712761:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4431
00000100:00100000:3.0:1776191208.712776:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b4fccb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630876480:12345-0@lo:400:kworker/u8:4.0 Request processed in 54us (1128us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191208.712786:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4428
00000100:00100000:1.0:1776191208.712793:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630876608
00000100:00100000:1.0:1776191208.712823:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630876672
00000100:00100000:1.0:1776191208.712836:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2197
00000100:00100000:1.0:1776191208.712840:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000994ca5e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630876608:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191208.712938:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191208.712979:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000041c7ca25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630876800:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191208.713005:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000af393e55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630876736:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191208.713007:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000994ca5e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630876608:12345-0@lo:8:kworker/u8:4.0 Request processed in 164us (540us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191208.713016:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2197
00000100:00100000:3.0:1776191208.713020:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f43f1e37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630876352:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191208.713050:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2198
00000100:00100000:1.0:1776191208.713057:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f135e4dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630876672:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191208.713201:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191208.713233:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d8a67d69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630876480:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191208.713255:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191208.713284:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630876544
00010000:02020000:1.0:1776191208.713297:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191208.713321:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f135e4dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630876672:12345-0@lo:8:kworker/u8:4.0 Request processed in 266us (810us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191208.713327:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2198
00000100:00080000:1.0:1776191208.713367:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191208.713371:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191208.713374:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e2ce3f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630876608:0@lo:8:kworker/u8:4.0
00000100:00080000:1.0:1776191208.713381:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191208.713383:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191208.713386:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ec90674 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630876672:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191208.713563:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630876416
00000100:00100000:2.0:1776191208.713580:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3019
00000100:00100000:2.0:1776191208.713585:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000097f506b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630876544:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191208.713624:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3020
00000100:00100000:2.0:1776191208.713629:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000097f506b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630876544:12345-0@lo:400:kworker/u8:4.0 Request processed in 43us (429us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191208.713636:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3019
00000100:00100000:1.0:1776191208.713687:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c4fd0f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630876416:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191208.713719:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c4fd0f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630876416:12345-0@lo:400:kworker/u8:4.0 Request processed in 89us (465us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191208.713761:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a8f703ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630876544:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191208.714542:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006776e411 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630876416:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191208.715058:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3020
00010000:00010000:3.0:1776191209.469266:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191210.334488:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191210.334535:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191210.334567:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191210.334610:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191210.334635:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191210.334668:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613785984
00000100:00100000:2.0:1776191210.334668:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613786048
00000100:00100000:2.0:1776191210.334705:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1942
00000100:00100000:2.0:1776191210.334712:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f7c58b5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613785984:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191210.334731:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613785792
00000100:00100000:3.0:1776191210.334755:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1675
00000100:00100000:3.0:1776191210.334759:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c45da90d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613785792:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191210.334778:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f7c58b5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613785984:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 67us (143us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191210.334781:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c45da90d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613785792:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 21us (301us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191210.334789:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1942
00000100:00100000:3.0:1776191210.334790:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1675
00000100:00100000:2.0:1776191210.334803:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2199
00000100:00100000:2.0:1776191210.334807:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006605fbf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613786048:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00000100:00100000:3.0:1776191210.334818:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613785920
00000100:00100000:3.0:1776191210.334837:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613785856
00000100:00100000:3.0:1776191210.334851:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4432
00000100:00100000:3.0:1776191210.334854:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000155ae841 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613785920:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191210.334879:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000155ae841 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613785920:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 24us (345us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191210.334885:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4432
00000100:00100000:3.0:1776191210.334895:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4433
00000100:00100000:3.0:1776191210.334899:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000567d6097 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613785856:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00010000:02020000:2.0:1776191210.334902:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191210.334917:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000567d6097 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613785856:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 18us (309us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191210.334922:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4433
00000100:00100000:1.0:1776191210.373285:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006605fbf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613786048:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 38473us (38714us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191210.373300:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2199
00010000:00010000:3.0:1776191210.490439:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191211.514348:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191211.774118:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191211.774140:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eae49c12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630876864:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191211.774207:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191211.774518:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630876864
00000100:00100000:0.0:1776191211.774569:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3021
00000100:00100000:0.0:1776191211.774575:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d9b79312 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630876864:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191211.774607:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191211.774670:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d9b79312 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630876864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (458us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191211.774676:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3021
00000100:00100000:3.0:1776191211.774981:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eae49c12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630876864:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191212.546453:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191212.796328:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000751b578a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630876928:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191212.796399:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191212.796500:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630876928
00000100:00100000:1.0:1776191212.796549:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3022
00000100:00100000:1.0:1776191212.796555:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d20676ab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630876928:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191212.796585:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191212.796638:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d20676ab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630876928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (241us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191212.796645:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3022
00000100:00100000:3.0:1776191212.796918:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000751b578a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630876928:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191213.562230:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191213.818374:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1776191213.818391:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f055ad1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630876992:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191213.818466:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191213.818641:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630876992
00000100:00100000:1.0:1776191213.818688:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1525
00000100:00100000:1.0:1776191213.818693:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f43f1e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630876992:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191213.818722:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191213.818761:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f43f1e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630876992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (296us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191213.818768:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1525
00000100:00100000:3.0:1776191213.818854:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f055ad1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630876992:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191213.819009:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000099f3d8e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630877056:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191213.819052:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1776191213.819392:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191213.819396:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191213.819399:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191213.819404:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3746
00000100:00080000:3.0:1776191213.819406:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191213.819409:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191213.819426:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000041c7ca25 x1862467630877440/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191213.819440:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191213.819443:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191213.819444:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191213.819447:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3746
00000100:00080000:3.0:1776191213.819448:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191213.819451:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191213.819462:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000009b397ad6 x1862467630877504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191213.819490:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ec90674 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630877184:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191213.819518:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191213.819532:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000b9cbeaa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630877568:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191213.819551:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191213.819567:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:3.0:1776191213.819572:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a8f703ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630877120:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191213.819598:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191213.819613:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000af393e55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630877376:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191213.819655:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191213.819681:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630877120
00000100:00100000:3.0:1776191213.819709:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1676
00000100:00100000:3.0:1776191213.819713:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002aaf4bb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630877120:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191213.819746:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002aaf4bb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630877120:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (148us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191213.819752:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1676
00000100:00100000:3.0:1776191213.819779:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630877184
00000100:00100000:3.0:1776191213.819800:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630877568
00000100:00100000:3.0:1776191213.819814:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4434
00000100:00100000:3.0:1776191213.819817:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc38b04d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630877184:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191213.819844:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc38b04d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630877184:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (326us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191213.819849:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4434
00000100:00100000:3.0:1776191213.819859:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4435
00000100:00100000:3.0:1776191213.819862:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b65b7705 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630877568:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191213.819896:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b65b7705 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630877568:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (345us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191213.819901:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4435
00000100:00100000:3.0:1776191213.819930:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a8f703ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630877120:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191213.819940:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ec90674 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630877184:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191213.819947:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000b9cbeaa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630877568:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191213.819967:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d8a67d69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630877312:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191213.819987:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191213.820002:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:3.0:1776191213.820007:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e2ce3f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630877248:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191213.820026:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191213.820058:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000348ababd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630877632:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191213.820088:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191213.820110:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630877312
00000100:00100000:3.0:1776191213.820129:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630877632
00000100:00100000:3.0:1776191213.820145:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4436
00000100:00100000:3.0:1776191213.820149:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000b9cbeaa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630877312:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191213.820179:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000b9cbeaa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630877312:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (192us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191213.820185:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4436
00000100:00100000:3.0:1776191213.820195:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4437
00000100:00100000:3.0:1776191213.820199:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a8f703ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630877632:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191213.820222:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a8f703ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630877632:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (134us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191213.820227:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4437
00000100:00100000:3.0:1776191213.820251:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000348ababd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630877632:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191213.820259:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d8a67d69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630877312:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191213.820395:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630877056
00000100:00100000:2.0:1776191213.820435:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1526
00000100:00100000:2.0:1776191213.820439:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006776e411 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630877056:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191213.820452:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191213.820481:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006776e411 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630877056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (1429us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191213.820486:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1526
00000100:00100000:1.0:1776191213.820752:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000041c7ca25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630877440:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191213.820780:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191213.820799:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b397ad6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630877504:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191213.820815:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191213.820838:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630877376
00000100:00100000:1.0:1776191213.820858:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630877248
00000100:00100000:1.0:1776191213.820867:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3023
00000100:00100000:1.0:1776191213.820870:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002a634854 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630877376:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191213.820910:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002a634854 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630877376:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (1255us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191213.820916:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3023
00000100:00100000:1.0:1776191213.820926:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3024
00000100:00100000:1.0:1776191213.820929:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ec90674 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630877248:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191213.820951:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ec90674 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630877248:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (925us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191213.820955:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3024
00000100:00100000:1.0:1776191213.820984:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000af393e55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630877376:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191213.821181:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630877440
00000100:00100000:0.0:1776191213.821210:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630877504
00000100:00100000:0.0:1776191213.821236:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2200
00000100:00100000:0.0:1776191213.821239:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001648d249 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630877440:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191213.821338:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191213.821371:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001648d249 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630877440:12345-0@lo:8:kworker/u8:2.0 Request processed in 131us (591us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191213.821376:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2200
00000100:00100000:0.0:1776191213.821385:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2201
00000100:00100000:0.0:1776191213.821388:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000087d9e22f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630877504:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191213.821481:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191213.821503:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000087d9e22f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630877504:12345-0@lo:8:kworker/u8:2.0 Request processed in 113us (688us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191213.821508:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2201
00000100:00080000:0.0:1776191213.821532:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191213.821535:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191213.821538:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000041c7ca25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630877440:0@lo:8:kworker/u8:2.0
00000100:00080000:0.0:1776191213.821544:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191213.821546:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191213.821548:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b397ad6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630877504:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191213.822249:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e2ce3f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630877248:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191213.822266:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000099f3d8e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630877056:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1776191214.586350:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191215.455813:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191215.455872:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191215.455911:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191215.455937:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191215.456006:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191215.456064:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613786112
00000100:00100000:0.0:1776191215.456105:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1677
00000100:00100000:0.0:1776191215.456112:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027ca70f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613786112:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191215.456182:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027ca70f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613786112:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 70us (272us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191215.456190:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1677
00000100:00100000:3.0:1776191215.456325:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613786304
00000100:00100000:3.0:1776191215.456359:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613786368
00000100:00100000:3.0:1776191215.456378:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1943
00000100:00100000:3.0:1776191215.456382:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b397ad6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613786304:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191215.456415:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b397ad6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613786304:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 32us (543us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191215.456420:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1943
00000100:00100000:3.0:1776191215.456432:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2202
00000100:00100000:3.0:1776191215.456436:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af172616 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613786368:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:3.0:1776191215.456532:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191215.456557:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af172616 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613786368:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 120us (552us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191215.456563:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2202
00000100:00100000:2.0:1776191215.456800:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613786176
00000100:00100000:2.0:1776191215.456854:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613786240
00000100:00100000:2.0:1776191215.456872:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4438
00000100:00100000:2.0:1776191215.456876:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dbd40b9d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613786176:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191215.456904:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dbd40b9d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613786176:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 27us (1098us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191215.456910:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4438
00000100:00100000:2.0:1776191215.456921:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4439
00000100:00100000:2.0:1776191215.456924:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af1b2795 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613786240:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191215.456942:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af1b2795 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613786240:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 17us (1006us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191215.456948:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4439
00010000:00010000:3.0:1776191215.610502:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191216.634277:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191216.891238:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630877696:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191216.891505:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191216.891598:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630877696
00000100:00100000:0.0:1776191216.891655:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3025
00000100:00100000:0.0:1776191216.891660:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e2ce3f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630877696:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191216.891689:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191216.891730:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e2ce3f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630877696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (227us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191216.891734:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3025
00000100:00100000:3.0:1776191216.891965:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630877696:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191217.658224:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191217.914431:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191217.914448:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000418a6d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630877760:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191217.914512:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191217.914767:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630877760
00000100:00100000:1.0:1776191217.914820:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3026
00000100:00100000:1.0:1776191217.914825:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8a67d69 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630877760:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191217.915497:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191217.915895:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8a67d69 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630877760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1068us (1383us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191217.915904:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3026
00000100:00100000:3.0:1776191217.917604:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000418a6d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630877760:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191218.683844:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191218.938256:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000041c7ca25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630877824:0@lo:400:kworker/u8:2.0
00000100:00080000:3.0:1776191218.938267:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191218.938272:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191218.938275:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191218.938281:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3751
00000100:00080000:3.0:1776191218.938283:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191218.938290:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191218.938311:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000087950b98 x1862467630878336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191218.938327:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191218.938330:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191218.938331:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191218.938336:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3751
00000100:00100000:2.0:1776191218.938339:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1776191218.938340:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191218.938345:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191218.938369:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000001abea6d8 x1862467630878400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191218.938379:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f2ed044 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630878080:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191218.938409:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191218.938433:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000af393e55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630877952:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191218.938449:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000090a9e988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630878464:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191218.938457:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191218.938473:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de454674 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630878208:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191218.938492:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191218.938497:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191218.938512:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [2->3]
00000100:00100000:3.0:1776191218.938516:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c02746a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630877888:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191218.938521:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:2.0:1776191218.938530:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000348ababd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630878016:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191218.938535:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191218.938548:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008ba1222e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630878144:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191218.938563:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191218.938588:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630878080
00000100:00100000:2.0:1776191218.938593:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c6718b89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630878272:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191218.938619:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191218.938620:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630877952
00000100:00100000:3.0:1776191218.938637:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630878464
00000100:00100000:3.0:1776191218.938652:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4440
00000100:00100000:3.0:1776191218.938657:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4fb1a2d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630878080:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191218.938661:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630877824
00000100:00100000:2.0:1776191218.938692:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1678
00000100:00100000:2.0:1776191218.938697:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb953a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630877824:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191218.938706:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4fb1a2d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630878080:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (296us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191218.938711:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4440
00000100:00100000:3.0:1776191218.938724:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4441
00000100:00100000:3.0:1776191218.938727:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001425031c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630877952:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191218.938738:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb953a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630877824:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (402us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191218.938747:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1678
00000100:00100000:3.0:1776191218.938750:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001425031c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630877952:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (292us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191218.938755:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4441
00000100:00100000:3.0:1776191218.938779:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4442
00000100:00100000:3.0:1776191218.938784:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000940c739a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630878464:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191218.938805:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630878016
00000100:00100000:3.0:1776191218.938812:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000940c739a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630878464:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (320us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191218.938818:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4442
00000100:00100000:2.0:1776191218.938834:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3027
00000100:00100000:2.0:1776191218.938841:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003b6ef48d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630878016:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191218.938843:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630877888
00000100:00100000:3.0:1776191218.938872:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1527
00000100:00100000:3.0:1776191218.938876:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004bce44f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630877888:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191218.938896:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191218.939091:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087950b98 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630878336:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191218.939248:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630878208
00000100:00100000:1.0:1776191218.939273:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630878272
00000100:00100000:1.0:1776191218.939290:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1944
00000100:00100000:1.0:1776191218.939294:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000424d0623 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630878208:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191218.939331:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004bce44f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630877888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 453us (798us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191218.939338:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000424d0623 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630878208:12345-0@lo:400:kworker/u8:2.0 Request processed in 42us (840us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191218.939342:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1527
00000100:00100000:1.0:1776191218.939350:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1944
00000100:00100000:1.0:1776191218.939364:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1945
00000100:00100000:1.0:1776191218.939368:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a8c7923 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630878272:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191218.939390:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a8c7923 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630878272:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (771us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191218.939394:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1945
00000100:00100000:3.0:1776191218.939441:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191218.939443:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1776191218.939452:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009fbbc7a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630878592:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191218.939463:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad4a7212 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630878528:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191218.939481:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191218.939495:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191218.939514:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630878144
00000100:00100000:3.0:1776191218.939532:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000af393e55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630877952:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191218.939538:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3028
00000100:00100000:1.0:1776191218.939543:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000034f2f5bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630878144:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191218.939642:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191218.939660:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001abea6d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630878400:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191218.939781:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191218.939808:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630878336
00000100:00100000:0.0:1776191218.939823:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630878400
00000100:00100000:0.0:1776191218.939835:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2203
00000100:00100000:0.0:1776191218.939838:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9d5bfab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630878336:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191218.939930:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191218.939959:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9d5bfab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630878336:12345-0@lo:8:kworker/u8:2.0 Request processed in 120us (318us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191218.939965:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2203
00000100:00100000:0.0:1776191218.939977:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2204
00000100:00100000:0.0:1776191218.939980:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000047e72ef1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630878400:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191218.940082:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191218.940105:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000047e72ef1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630878400:12345-0@lo:8:kworker/u8:2.0 Request processed in 124us (325us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191218.940111:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2204
00000100:00080000:0.0:1776191218.940252:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191218.940257:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191218.940261:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087950b98 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630878336:0@lo:8:kworker/u8:2.0
00000100:00080000:0.0:1776191218.940269:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191218.940271:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191218.940273:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001abea6d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630878400:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191218.940315:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630878592
00000100:00100000:0.0:1776191218.940336:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1528
00000100:00100000:0.0:1776191218.940339:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048199cde pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630878592:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191218.940352:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191218.940453:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de454674 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630878208:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191218.940482:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c02746a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630877888:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191218.940504:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630878528
00000100:00100000:3.0:1776191218.940528:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4443
00000100:00100000:3.0:1776191218.940532:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000cbdfd62 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630878528:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191218.940664:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000cbdfd62 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630878528:12345-0@lo:400:kworker/u8:2.0 Request processed in 130us (1170us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191218.940691:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000034f2f5bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630878144:12345-0@lo:400:kworker/u8:2.0 Request processed in 1146us (1251us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191218.940698:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3028
00000100:00100000:1.0:1776191218.940747:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000348ababd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630878016:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191218.940757:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c6718b89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630878272:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191218.940778:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4443
00000100:00100000:1.0:1776191218.940779:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000090a9e988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630878464:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191218.940794:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f2ed044 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630878080:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191218.940806:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000041c7ca25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630877824:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191218.940821:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008ba1222e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630878144:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191218.940835:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad4a7212 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630878528:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191218.941318:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048199cde pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630878592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 976us (1837us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191218.941325:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1528
00000100:00100000:1.0:1776191218.941498:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009fbbc7a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630878592:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191218.943976:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003b6ef48d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630878016:12345-0@lo:400:kworker/u8:2.0 Request processed in 5130us (5408us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191218.943989:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3027
00010000:00010000:3.0:1776191219.706414:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191220.570470:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191220.570701:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191220.570740:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613786496
00000100:00100000:0.0:1776191220.570765:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191220.570789:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4444
00000100:00100000:3.0:1776191220.570797:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9d5bfab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613786496:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191220.570812:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191220.570936:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613786432
00000100:00100000:2.0:1776191220.570965:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1679
00000100:00100000:2.0:1776191220.570971:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a5cfa2a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613786432:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191220.571165:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191220.571182:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9d5bfab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613786496:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 383us (715us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191220.571191:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4444
00000100:00100000:3.0:1776191220.571209:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613786560
00000100:00100000:3.0:1776191220.571231:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4445
00000100:00100000:3.0:1776191220.571235:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a27cd066 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613786560:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191220.571264:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a27cd066 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613786560:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 27us (98us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191220.571270:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4445
00000100:00100000:0.0:1776191220.571295:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613786688
00000100:00100000:0.0:1776191220.571317:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613786624
00000100:00100000:0.0:1776191220.571339:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1946
00000100:00100000:0.0:1776191220.571344:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000011d3c5e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613786624:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191220.571359:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2205
00000100:00100000:3.0:1776191220.571365:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000abb7dbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613786688:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00000100:00100000:0.0:1776191220.571383:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000011d3c5e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613786624:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 38us (572us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191220.571390:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1946
00010000:02020000:3.0:1776191220.571460:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191220.571493:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000abb7dbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613786688:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 127us (794us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191220.571499:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2205
00000100:00100000:2.0:1776191220.574095:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a5cfa2a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613786432:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 3113us (3321us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191220.574112:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1679
00010000:00010000:3.0:1776191220.732416:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191221.754422:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191222.010737:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191222.010760:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a26e20f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630878656:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191222.010879:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191222.011018:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630878656
00000100:00100000:2.0:1776191222.011125:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3029
00000100:00100000:2.0:1776191222.011132:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad4a7212 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630878656:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191222.011164:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191222.011218:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad4a7212 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630878656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (341us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191222.011226:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3029
00000100:00100000:3.0:1776191222.011295:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a26e20f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630878656:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191222.780825:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191223.035981:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776191223.035999:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a26e20f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630878720:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191223.036094:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191223.036372:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630878720
00000100:00100000:1.0:1776191223.036423:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3030
00000100:00100000:1.0:1776191223.036430:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000079aa8992 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630878720:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191223.036462:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191223.036514:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000079aa8992 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630878720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (419us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191223.036521:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3030
00000100:00100000:3.0:1776191223.036610:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a26e20f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630878720:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191223.802270:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191224.058256:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c02746a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630878848:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191224.058509:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191224.058544:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009fbbc7a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630878784:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191224.058565:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191224.058602:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630878848
00000100:00100000:1.0:1776191224.058633:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630878784
00000100:00100000:1.0:1776191224.058647:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1529
00000100:00100000:1.0:1776191224.058652:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000102502dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630878848:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191224.058696:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191224.058731:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000102502dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630878848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (408us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191224.058737:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1529
00000100:00100000:1.0:1776191224.058753:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1530
00000100:00100000:1.0:1776191224.058757:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fadf7139 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630878784:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191224.058765:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191224.058789:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fadf7139 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630878784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 32us (224us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191224.058794:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1530
00000100:00100000:1.0:1776191224.058825:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c02746a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630878848:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191224.058834:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009fbbc7a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630878784:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191224.059829:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1776191224.059934:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191224.060025:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cea0d9c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630878912:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191224.060084:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191224.060160:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630878912
00000100:00100000:3.0:1776191224.060201:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1680
00000100:00100000:3.0:1776191224.060205:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c7de7df8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630878912:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191224.060259:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c7de7df8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630878912:12345-0@lo:400:kworker/u8:2.0 Request processed in 53us (176us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191224.060266:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1680
00000100:00100000:1.0:1776191224.060453:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cea0d9c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630878912:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191224.060589:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc7ab3d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630879040:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191224.060622:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191224.060647:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa646f87 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630878976:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191224.060683:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191224.060791:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630879040
00000100:00100000:3.0:1776191224.060826:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3031
00000100:00100000:3.0:1776191224.060830:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f22abe6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630879040:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191224.060879:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f22abe6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630879040:12345-0@lo:400:kworker/u8:2.0 Request processed in 48us (257us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191224.060886:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3031
00000100:00100000:2.0:1776191224.060958:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc7ab3d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630879040:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191224.061459:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc7ab3d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630879104:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191224.061487:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1776191224.061523:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191224.061528:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191224.061531:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191224.061535:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3757
00000100:00080000:0.0:1776191224.061538:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191224.061541:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191224.061561:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000008ba1222e x1862467630879232/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191224.061577:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191224.061580:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191224.061581:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191224.061584:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3757
00000100:00080000:0.0:1776191224.061586:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191224.061588:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191224.061598:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000007f2ed044 x1862467630879296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191224.061638:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008ba1222e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630879232:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191224.061891:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191224.061912:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f2ed044 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630879296:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191224.061936:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191224.061967:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630879232
00000100:00100000:0.0:1776191224.061990:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630879296
00000100:00100000:0.0:1776191224.062007:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2206
00000100:00100000:0.0:1776191224.062011:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001abea6d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630879232:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191224.062235:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191224.062273:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001abea6d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630879232:12345-0@lo:8:kworker/u8:2.0 Request processed in 261us (382us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191224.062280:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2206
00000100:00100000:0.0:1776191224.062295:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2207
00000100:00100000:0.0:1776191224.062298:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000087950b98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630879296:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191224.062470:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191224.062494:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000087950b98 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630879296:12345-0@lo:8:kworker/u8:2.0 Request processed in 195us (558us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191224.062500:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2207
00000100:00080000:0.0:1776191224.062532:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191224.062535:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191224.062538:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008ba1222e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630879232:0@lo:8:kworker/u8:2.0
00000100:00080000:0.0:1776191224.062545:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191224.062547:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191224.062549:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f2ed044 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630879296:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191224.062571:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c6718b89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630879360:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191224.062599:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de454674 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630879424:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191224.062690:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cea0d9c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630879168:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191224.062720:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191224.062853:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630879168
00000100:00100000:0.0:1776191224.062889:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3032
00000100:00100000:0.0:1776191224.062893:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2a7dce2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630879168:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191224.062934:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2a7dce2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630879168:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (214us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191224.062939:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3032
00000100:00100000:3.0:1776191224.063008:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cea0d9c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630879168:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191224.063145:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630878976
00000100:00100000:1.0:1776191224.063172:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630879104
00000100:00100000:1.0:1776191224.063186:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4446
00000100:00100000:1.0:1776191224.063190:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008cc360bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630878976:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191224.063245:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4447
00000100:00100000:3.0:1776191224.063250:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f76e3cf5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630879104:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191224.063281:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191224.063431:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630879424
00000100:00100000:0.0:1776191224.063455:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4448
00000100:00100000:0.0:1776191224.063458:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f2ed044 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630879424:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191224.063498:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f2ed044 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630879424:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (217us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191224.063505:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4448
00000100:00100000:0.0:1776191224.063523:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191224.063544:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630879360
00000100:00100000:0.0:1776191224.063563:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4449
00000100:00100000:0.0:1776191224.063567:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008ba1222e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630879360:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191224.063596:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008ba1222e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630879360:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (73us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191224.063601:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4449
00000100:00100000:0.0:1776191224.063626:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c6718b89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630879360:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191224.063646:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de454674 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630879424:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191224.063779:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008cc360bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630878976:12345-0@lo:400:kworker/u8:2.0 Request processed in 588us (3095us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191224.063786:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4446
00000100:00100000:0.0:1776191224.063848:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa646f87 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630878976:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191224.063906:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f76e3cf5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630879104:12345-0@lo:400:kworker/u8:2.0 Request processed in 656us (2419us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191224.063912:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4447
00000100:00100000:2.0:1776191224.064024:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc7ab3d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630879104:0@lo:400:kworker/u8:2.0
00010000:00010000:3.0:1776191224.828130:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191225.691394:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191225.691439:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191225.691462:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191225.691503:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191225.691578:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613786816
00000100:00100000:3.0:1776191225.691605:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613786880
00000100:00100000:2.0:1776191225.691676:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4450
00000100:00100000:2.0:1776191225.691684:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de454674 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613786816:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191225.691703:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613786752
00000100:00100000:1.0:1776191225.691740:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1681
00000100:00100000:1.0:1776191225.691746:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000071188990 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613786752:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191225.691760:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de454674 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613786816:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 76us (320us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191225.691769:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4450
00000100:00100000:2.0:1776191225.691788:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4451
00000100:00100000:2.0:1776191225.691792:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c6718b89 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613786880:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191225.691817:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c6718b89 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613786880:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 24us (355us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191225.691822:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4451
00000100:00100000:1.0:1776191225.691877:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071188990 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613786752:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 129us (492us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191225.691884:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1681
00000100:00100000:1.0:1776191225.691940:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613786944
00000100:00100000:1.0:1776191225.691965:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1947
00000100:00100000:1.0:1776191225.691969:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006eae40ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613786944:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191225.691994:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006eae40ed pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613786944:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 24us (491us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191225.692000:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1947
00000100:00100000:0.0:1776191225.716790:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191225.719048:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613787008
00000100:00100000:2.0:1776191225.719378:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2208
00000100:00100000:2.0:1776191225.719386:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006821defb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613787008:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:2.0:1776191225.719495:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191225.719584:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006821defb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613787008:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 197us (2800us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191225.719592:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2208
00010000:00010000:3.0:1776191225.853053:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191226.874265:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191227.132261:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1776191227.132278:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a8c7923 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630879488:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191227.132338:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191227.132494:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630879488
00000100:00100000:0.0:1776191227.132541:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3033
00000100:00100000:0.0:1776191227.132547:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ce2fb2ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630879488:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191227.132576:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191227.132640:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ce2fb2ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630879488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (302us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191227.132647:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3033
00000100:00100000:3.0:1776191227.132794:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a8c7923 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630879488:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191227.898228:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191228.155189:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1776191228.155274:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000418a6d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630879552:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191228.155686:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191228.155823:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630879552
00000100:00100000:2.0:1776191228.155858:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3034
00000100:00100000:2.0:1776191228.155866:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009fbbc7a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630879552:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191228.155899:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191228.155942:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009fbbc7a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630879552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (257us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191228.155948:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3034
00000100:00100000:1.0:1776191228.155970:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000418a6d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630879552:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191228.922522:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191229.178231:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:1.0:1776191229.178253:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630879616:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191229.178313:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191229.178345:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1e9431d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630879680:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191229.178365:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191229.178498:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630879616
00000100:00100000:3.0:1776191229.178507:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630879680
00000100:00100000:3.0:1776191229.178656:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1531
00000100:00100000:3.0:1776191229.178661:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001648d249 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630879680:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191229.178689:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191229.178732:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001648d249 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630879680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (366us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191229.178738:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1531
00000100:00100000:0.0:1776191229.179002:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1e9431d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630879680:0@lo:13:osp-pre-0-0.0
00000100:00080000:1.0:1776191229.179160:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191229.179164:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191229.179168:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191229.179173:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3762
00000100:00080000:1.0:1776191229.179175:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191229.179179:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191229.179198:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000ef14d805 x1862467630880064/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191229.179210:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191229.179212:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191229.179213:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191229.179216:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3762
00000100:00080000:1.0:1776191229.179217:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191229.179219:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191229.179228:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000006165bc89 x1862467630880128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191229.179256:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000090a9e988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630879936:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191229.179286:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191229.179303:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:1.0:1776191229.179308:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087d9e22f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630879744:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191229.179344:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191229.179357:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c904ec5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630880000:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191229.179377:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191229.179399:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630879744
00000100:00100000:1.0:1776191229.179424:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1682
00000100:00100000:1.0:1776191229.179427:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c42de81a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630879744:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191229.179456:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c42de81a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630879744:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (112us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191229.179462:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1682
00000100:00100000:1.0:1776191229.179486:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630880000
00000100:00100000:1.0:1776191229.179508:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3035
00000100:00100000:1.0:1776191229.179511:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001bc0bbec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630880000:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191229.179538:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001bc0bbec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630880000:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (160us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191229.179554:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3035
00000100:00100000:1.0:1776191229.179581:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087d9e22f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630879744:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191229.179591:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c904ec5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630880000:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191229.179624:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f055ad1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630879808:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191229.179647:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191229.179663:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007ea65731 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630880192:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191229.179678:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191229.179693:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:1.0:1776191229.179698:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1e9431d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630879872:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191229.179716:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191229.179729:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000455a3f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630880256:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191229.179745:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191229.179767:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630879936
00000100:00100000:1.0:1776191229.179787:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630879808
00000100:00100000:1.0:1776191229.179799:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630880192
00000100:00100000:0.0:1776191229.180381:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ef14d805 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630880064:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191229.180416:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191229.180436:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006165bc89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630880128:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191229.180456:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191229.180488:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630880256
00000100:00100000:0.0:1776191229.180510:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4452
00000100:00100000:0.0:1776191229.180514:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f6f66ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630879936:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191229.180566:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f6f66ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630879936:12345-0@lo:400:kworker/u8:4.0 Request processed in 51us (1280us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191229.180572:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4452
00000100:00100000:0.0:1776191229.180585:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4453
00000100:00100000:0.0:1776191229.180589:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000911fdeb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630879808:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191229.180624:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000911fdeb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630879808:12345-0@lo:400:kworker/u8:4.0 Request processed in 34us (977us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191229.180630:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4453
00000100:00100000:0.0:1776191229.180642:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4454
00000100:00100000:0.0:1776191229.180645:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000301f1ca1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630880192:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191229.180671:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000301f1ca1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630880192:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (992us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191229.180677:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4454
00000100:00100000:0.0:1776191229.180688:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4455
00000100:00100000:0.0:1776191229.180691:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070c80d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630880256:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191229.180715:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070c80d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630880256:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (970us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191229.180720:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4455
00000100:00100000:0.0:1776191229.180749:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630880064
00000100:00100000:0.0:1776191229.180767:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630880128
00000100:00100000:0.0:1776191229.180779:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2209
00000100:00100000:0.0:1776191229.180783:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de02bb16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630880064:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191229.181099:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191229.181146:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de02bb16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630880064:12345-0@lo:8:kworker/u8:4.0 Request processed in 362us (730us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191229.181153:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2209
00000100:00100000:0.0:1776191229.181166:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2210
00000100:00100000:0.0:1776191229.181169:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ff6c3c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630880128:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191229.181250:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191229.181276:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ff6c3c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630880128:12345-0@lo:8:kworker/u8:4.0 Request processed in 106us (820us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191229.181282:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2210
00000100:00080000:0.0:1776191229.181319:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191229.181323:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191229.181326:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ef14d805 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630880064:0@lo:8:kworker/u8:4.0
00000100:00080000:0.0:1776191229.181335:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191229.181337:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191229.181339:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006165bc89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630880128:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191229.181374:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000455a3f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630880256:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191229.181384:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f055ad1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630879808:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191229.181393:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007ea65731 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630880192:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191229.181422:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000090a9e988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630879936:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191229.181478:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630879872
00000100:00100000:0.0:1776191229.181503:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3036
00000100:00100000:0.0:1776191229.181507:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000636d25c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630879872:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191229.181541:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000636d25c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630879872:12345-0@lo:400:kworker/u8:4.0 Request processed in 33us (1824us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191229.181559:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3036
00000100:00100000:0.0:1776191229.181582:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1e9431d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630879872:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191229.182991:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1532
00000100:00100000:2.0:1776191229.182999:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e30dc2ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630879616:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191229.183023:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191229.183104:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e30dc2ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630879616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (4791us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191229.183120:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1532
00000100:00100000:1.0:1776191229.186896:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630879616:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1776191229.946786:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191230.813351:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191230.814928:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191230.814972:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191230.815014:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191230.815080:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613787328
00000100:00100000:3.0:1776191230.815080:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613787264
00000100:00100000:1.0:1776191230.815156:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613787136
00000100:00100000:1.0:1776191230.815190:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4456
00000100:00100000:1.0:1776191230.815196:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090a9e988 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613787136:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191230.815267:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090a9e988 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613787136:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 70us (344us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191230.815274:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4456
00000100:00100000:0.0:1776191230.815328:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1948
00000100:00100000:0.0:1776191230.815333:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000056503154 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613787264:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191230.815362:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000056503154 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613787264:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 28us (391us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191230.815368:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1948
00000100:00100000:0.0:1776191230.815380:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2211
00000100:00100000:0.0:1776191230.815384:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b8ca8296 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613787328:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:0.0:1776191230.815477:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191230.815503:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b8ca8296 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613787328:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 118us (490us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191230.815519:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2211
00000100:00100000:2.0:1776191230.817202:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613787072
00000100:00100000:2.0:1776191230.817259:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1683
00000100:00100000:2.0:1776191230.817266:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc7ff80b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613787072:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191230.817324:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc7ff80b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613787072:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 57us (3981us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191230.817332:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1683
00000100:00100000:3.0:1776191230.819545:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191230.819585:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613787200
00000100:00100000:3.0:1776191230.819626:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4457
00000100:00100000:3.0:1776191230.819631:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000074fc7059 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613787200:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191230.819696:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000074fc7059 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613787200:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 63us (158us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191230.819704:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4457
00010000:00010000:3.0:1776191230.970420:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191231.994864:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191232.250639:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000099f3d8e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630880320:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191232.250707:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191232.250806:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630880320
00000100:00100000:1.0:1776191232.250858:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3037
00000100:00100000:1.0:1776191232.250864:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005da74066 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630880320:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191232.250905:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191232.251905:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005da74066 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630880320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1035us (1193us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191232.251915:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3037
00000100:00100000:0.0:1776191232.252592:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000099f3d8e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630880320:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191233.018237:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191233.275536:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776191233.275557:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000751b578a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630880384:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191233.275626:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191233.275984:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630880384
00000100:00100000:2.0:1776191233.276067:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3038
00000100:00100000:2.0:1776191233.276074:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe4d38b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630880384:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191233.276104:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191233.276500:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe4d38b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630880384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 424us (874us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191233.276507:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3038
00000100:00100000:0.0:1776191233.279146:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000751b578a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630880384:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191234.045099:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1776191234.299615:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191234.299622:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191234.299625:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191234.299634:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3767
00000100:00080000:0.0:1776191234.299637:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191234.299643:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191234.299663:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000fd189403 x1862467630881024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191234.299696:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191234.299699:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191234.299701:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191234.299703:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3767
00000100:00080000:0.0:1776191234.299705:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191234.299708:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191234.299719:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000a23f3206 x1862467630881088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191234.299760:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eae49c12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630880512:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191234.299826:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191234.299852:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000013b80f08 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630880768:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191234.299875:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191234.299888:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f1df7d70 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630881152:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191234.299911:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191234.299929:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [2->3]
00000100:00100000:0.0:1776191234.299934:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000321faac3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630880448:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191234.299954:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191234.299965:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000719a2127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630880704:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191234.299985:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191234.299997:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005693775e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630880960:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191234.300017:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191234.300065:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fd189403 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630881024:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191234.300088:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191234.300100:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a23f3206 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630881088:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191234.300118:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191234.300156:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630880512
00000100:00100000:0.0:1776191234.300191:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630880448
00000100:00100000:0.0:1776191234.300382:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1533
00000100:00100000:0.0:1776191234.300389:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3653833 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630880512:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191234.300418:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191234.300469:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3653833 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630880512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (643us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191234.300476:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1533
00000100:00100000:0.0:1776191234.300494:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1534
00000100:00100000:0.0:1776191234.300498:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f7c58b5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630880448:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191234.300508:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191234.300529:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f7c58b5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630880448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 30us (574us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191234.300534:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1534
00000100:00100000:0.0:1776191234.300554:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630880960
00000100:00100000:0.0:1776191234.300575:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630881024
00000100:00100000:0.0:1776191234.300589:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630881088
00000100:00100000:0.0:1776191234.300603:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1949
00000100:00100000:0.0:1776191234.300607:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b397ad6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630880960:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191234.300637:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b397ad6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630880960:12345-0@lo:400:kworker/u8:4.0 Request processed in 29us (619us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191234.300646:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1949
00000100:00100000:0.0:1776191234.300658:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2212
00000100:00100000:0.0:1776191234.300662:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ea65731 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630881024:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191234.300986:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191234.301022:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ea65731 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630881024:12345-0@lo:8:kworker/u8:4.0 Request processed in 358us (933us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191234.301028:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2212
00000100:00100000:0.0:1776191234.301066:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2213
00000100:00100000:0.0:1776191234.301069:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000455a3f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630881088:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191234.301245:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630880704
00000100:00100000:3.0:1776191234.301280:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3039
00000100:00100000:3.0:1776191234.301284:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f135e4dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630880704:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191234.301317:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f135e4dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630880704:12345-0@lo:400:kworker/u8:4.0 Request processed in 32us (1331us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191234.301322:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3039
00000100:00100000:3.0:1776191234.301343:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630880768
00000100:00100000:3.0:1776191234.301364:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630881152
00000100:00100000:3.0:1776191234.301383:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4458
00000100:00100000:3.0:1776191234.301386:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006605fbf0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630880768:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191234.301414:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006605fbf0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630880768:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (1539us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191234.301420:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4458
00000100:00100000:3.0:1776191234.301430:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4459
00000100:00100000:3.0:1776191234.301449:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b5c3f068 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630881152:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191234.301472:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b5c3f068 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630881152:12345-0@lo:400:kworker/u8:4.0 Request processed in 38us (1562us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191234.301481:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4459
00000100:00100000:3.0:1776191234.303618:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000321faac3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630880448:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191234.303635:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000719a2127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630880704:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191234.303645:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005693775e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630880960:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191234.303659:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eae49c12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630880512:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191234.303669:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000013b80f08 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630880768:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191234.303678:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f1df7d70 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630881152:0@lo:400:kworker/u8:4.0
00000100:00080000:3.0:1776191234.303739:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191234.303743:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191234.303746:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fd189403 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630881024:0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191234.304068:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191234.304140:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000455a3f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630881088:12345-0@lo:8:kworker/u8:4.0 Request processed in 3069us (4021us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191234.304149:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2213
00000100:00100000:2.0:1776191234.304358:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ea1acb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630880640:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191234.304460:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191234.304486:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a11d1076 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630880896:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191234.304507:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191234.304522:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [0->1]
00000100:00100000:2.0:1776191234.304528:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000022db519c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630880576:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191234.304553:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191234.304569:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae36b234 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630880832:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191234.304591:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191234.304606:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000994ca5e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630881216:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191234.304625:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191234.304656:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630880640
00000100:00100000:2.0:1776191234.304703:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630881216
00000100:00100000:2.0:1776191234.304720:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4460
00000100:00100000:2.0:1776191234.304724:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eae49c12 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630880640:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191234.304768:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eae49c12 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630880640:12345-0@lo:400:kworker/u8:4.0 Request processed in 43us (308us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191234.304774:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4460
00000100:00100000:2.0:1776191234.304785:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4461
00000100:00100000:2.0:1776191234.304789:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008790082b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630881216:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191234.304812:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008790082b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630881216:12345-0@lo:400:kworker/u8:4.0 Request processed in 22us (186us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191234.304817:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4461
00000100:00100000:2.0:1776191234.304836:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630880832
00000100:00100000:2.0:1776191234.304859:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3040
00000100:00100000:2.0:1776191234.304862:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007c94492b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630880832:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191234.304888:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007c94492b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630880832:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (296us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191234.304894:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3040
00000100:00100000:2.0:1776191234.304911:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630880896
00000100:00100000:2.0:1776191234.304936:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1950
00000100:00100000:2.0:1776191234.304940:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f6732c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630880896:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191234.304967:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f6732c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630880896:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (459us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191234.304973:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1950
00000100:00100000:2.0:1776191234.304996:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630880576
00000100:00100000:2.0:1776191234.305017:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1684
00000100:00100000:2.0:1776191234.305021:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bcb4f46f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630880576:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191234.305076:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bcb4f46f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630880576:12345-0@lo:400:kworker/u8:4.0 Request processed in 54us (523us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191234.305083:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1684
00000100:00100000:2.0:1776191234.305142:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000022db519c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630880576:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191234.305153:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae36b234 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630880832:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191234.305161:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000994ca5e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630881216:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191234.305169:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ea1acb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630880640:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191234.305176:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a11d1076 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630880896:0@lo:400:kworker/u8:4.0
00000100:00080000:3.0:1776191234.309785:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191234.309794:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191234.309801:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a23f3206 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630881088:0@lo:8:kworker/u8:4.0
00010000:00010000:3.0:1776191235.066215:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191235.932611:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191235.932665:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191235.932688:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191235.932712:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191235.932730:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191235.932832:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613787520
00000100:00100000:0.0:1776191235.932900:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613787456
00000100:00100000:0.0:1776191235.932920:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4462
00000100:00100000:0.0:1776191235.932926:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036b83f3c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613787520:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191235.932999:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036b83f3c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613787520:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 72us (311us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191235.933007:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4462
00000100:00100000:0.0:1776191235.933022:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4463
00000100:00100000:0.0:1776191235.933026:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002a49d837 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613787456:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191235.933088:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002a49d837 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613787456:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 61us (376us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191235.933106:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4463
00000100:00100000:0.0:1776191235.933137:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613787648
00000100:00100000:0.0:1776191235.933153:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613787584
00000100:00100000:0.0:1776191235.933170:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1951
00000100:00100000:0.0:1776191235.933174:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009df06d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613787584:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191235.933426:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009df06d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613787584:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 250us (694us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191235.933433:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1951
00000100:00100000:0.0:1776191235.933445:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2214
00000100:00100000:0.0:1776191235.933448:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000808245d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613787648:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:0.0:1776191235.933551:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191235.933577:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000808245d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613787648:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 128us (975us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191235.933584:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2214
00000100:00100000:3.0:1776191235.934541:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613787392
00000100:00100000:3.0:1776191235.934638:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1685
00000100:00100000:3.0:1776191235.934643:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ac96f048 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613787392:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191235.934689:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ac96f048 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613787392:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 45us (2024us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191235.934695:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1685
00010000:00010000:3.0:1776191236.091281:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191237.115318:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191237.370296:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191237.370552:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c4fb1a2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630881280:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191237.370624:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191237.370732:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630881280
00000100:00100000:2.0:1776191237.370861:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3041
00000100:00100000:2.0:1776191237.370870:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c1848a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630881280:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191237.370904:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191237.370994:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c1848a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630881280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (370us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191237.371002:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3041
00000100:00100000:1.0:1776191237.371189:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c4fb1a2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630881280:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191238.138810:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191238.394915:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630881344:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191238.394987:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191238.396614:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630881344
00000100:00100000:2.0:1776191238.396951:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3042
00000100:00100000:2.0:1776191238.396958:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2988da5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630881344:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191238.396998:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191238.397104:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2988da5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630881344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (2117us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191238.397111:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3042
00000100:00100000:1.0:1776191238.400586:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630881344:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191239.162713:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191239.418409:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1776191239.418532:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191239.418546:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000321faac3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630881472:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191239.418631:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191239.418770:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008cc360bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630881408:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191239.418797:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191239.418912:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630881472
00000100:00100000:3.0:1776191239.418955:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630881408
00000100:00100000:3.0:1776191239.418973:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1535
00000100:00100000:3.0:1776191239.418978:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a6460e87 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630881472:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191239.419006:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191239.419061:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a6460e87 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630881472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (430us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191239.419068:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1535
00000100:00100000:3.0:1776191239.419084:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1536
00000100:00100000:3.0:1776191239.419088:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d06252d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630881408:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191239.419098:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191239.419122:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d06252d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630881408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (325us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191239.419128:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1536
00000100:00100000:3.0:1776191239.419161:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000321faac3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630881472:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191239.419395:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008cc360bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630881408:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191239.419652:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b5b887d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630881536:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191239.419687:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191239.419752:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630881536
00000100:00100000:2.0:1776191239.419792:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1686
00000100:00100000:2.0:1776191239.419796:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b37044fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630881536:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191239.420091:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008cc5f0ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630881728:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191239.420120:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191239.420151:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630881728
00000100:00100000:1.0:1776191239.420179:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4464
00000100:00100000:1.0:1776191239.420183:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ff832465 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630881728:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191239.420217:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ff832465 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630881728:12345-0@lo:400:kworker/u8:4.0 Request processed in 32us (97us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191239.420224:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4464
00000100:00100000:1.0:1776191239.420250:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008cc5f0ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630881728:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191239.420280:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a34feed9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630881664:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191239.420305:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191239.420330:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776191239.420337:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086c77a9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630881600:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191239.420357:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191239.420382:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630881664
00000100:00100000:1.0:1776191239.420407:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3043
00000100:00100000:1.0:1776191239.420411:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006be09a24 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630881664:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191239.420458:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006be09a24 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630881664:12345-0@lo:400:kworker/u8:4.0 Request processed in 46us (153us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191239.420465:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3043
00000100:00100000:1.0:1776191239.420483:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630881600
00000100:00100000:1.0:1776191239.420501:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4465
00000100:00100000:1.0:1776191239.420505:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000025d8d2e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630881600:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191239.420531:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000025d8d2e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630881600:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (173us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191239.420537:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4465
00000100:00100000:1.0:1776191239.420559:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086c77a9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630881600:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191239.420589:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a34feed9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630881664:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191239.424639:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b37044fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630881536:12345-0@lo:400:kworker/u8:4.0 Request processed in 4833us (4943us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191239.424656:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1686
00000100:00080000:3.0:1776191239.425941:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191239.425947:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191239.425950:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191239.425957:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3772
00000100:00080000:3.0:1776191239.425960:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191239.425967:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191239.425990:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000c345c5b9 x1862467630881856/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191239.426018:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191239.426021:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191239.426022:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191239.426025:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3772
00000100:00080000:3.0:1776191239.426027:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191239.426030:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191239.426059:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000698fe8e7 x1862467630881920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191239.427259:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b5b887d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630881536:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191239.427296:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a70c215b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630881792:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191239.427378:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191239.428750:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630881792
00000100:00100000:3.0:1776191239.428815:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3044
00000100:00100000:3.0:1776191239.428821:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000042aec8a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630881792:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191239.428885:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000042aec8a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630881792:12345-0@lo:400:kworker/u8:4.0 Request processed in 63us (1508us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191239.428893:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3044
00000100:00100000:2.0:1776191239.429257:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c345c5b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630881856:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191239.429298:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191239.429318:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000698fe8e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630881920:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191239.429349:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191239.429379:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630881856
00000100:00100000:2.0:1776191239.429398:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630881920
00000100:00100000:2.0:1776191239.429409:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2215
00000100:00100000:2.0:1776191239.429412:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f76e3cf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630881856:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191239.429505:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191239.429534:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f76e3cf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630881856:12345-0@lo:8:kworker/u8:4.0 Request processed in 121us (237us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191239.429540:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2215
00000100:00100000:2.0:1776191239.429550:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2216
00000100:00100000:2.0:1776191239.429553:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000751b578a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630881920:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191239.429680:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191239.429702:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000751b578a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630881920:12345-0@lo:8:kworker/u8:4.0 Request processed in 147us (353us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191239.429707:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2216
00000100:00080000:2.0:1776191239.429736:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191239.429740:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191239.429743:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c345c5b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630881856:0@lo:8:kworker/u8:4.0
00000100:00080000:2.0:1776191239.429751:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191239.429753:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191239.429756:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000698fe8e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630881920:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191239.429827:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a70c215b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630881792:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191239.430915:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ed5180d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630881984:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191239.430968:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191239.431006:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1776191239.431012:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5d3af6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630882048:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191239.431031:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191239.431245:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630881984
00000100:00100000:0.0:1776191239.431288:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630882048
00000100:00100000:0.0:1776191239.431316:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4466
00000100:00100000:0.0:1776191239.431321:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c70cf3d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630881984:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191239.431377:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c70cf3d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630881984:12345-0@lo:400:kworker/u8:4.0 Request processed in 55us (410us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191239.431384:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4466
00000100:00100000:0.0:1776191239.431396:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4467
00000100:00100000:0.0:1776191239.431400:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dbbf2c39 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630882048:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191239.431425:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dbbf2c39 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630882048:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (394us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191239.431431:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4467
00000100:00100000:1.0:1776191239.431550:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5d3af6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630882048:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191239.431560:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ed5180d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630881984:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191240.186294:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191241.053114:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191241.053147:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191241.053184:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191241.053215:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191241.053242:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191241.053266:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613787904
00000100:00100000:3.0:1776191241.053313:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613787968
00000100:00100000:2.0:1776191241.053434:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613787776
00000100:00100000:2.0:1776191241.053469:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613787840
00000100:00100000:2.0:1776191241.053485:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4468
00000100:00100000:2.0:1776191241.053490:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae81ed6a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613787776:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191241.053555:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae81ed6a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613787776:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 64us (447us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191241.053563:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4468
00000100:00100000:0.0:1776191241.053577:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613787712
00000100:00100000:2.0:1776191241.053581:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4469
00000100:00100000:2.0:1776191241.053586:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b1b67b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613787840:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191241.053607:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b1b67b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613787840:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 21us (393us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191241.053611:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1687
00000100:00100000:0.0:1776191241.053622:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004e50600 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613787712:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191241.053623:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4469
00000100:00100000:0.0:1776191241.053660:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004e50600 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613787712:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 41us (476us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191241.053666:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1687
00000100:00100000:3.0:1776191241.053709:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1952
00000100:00100000:3.0:1776191241.053717:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ac42fbca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613787904:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191241.053731:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2217
00000100:00100000:2.0:1776191241.053736:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006de4f7b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613787968:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00000100:00100000:3.0:1776191241.053746:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ac42fbca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613787904:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 28us (598us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191241.053753:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1952
00010000:02020000:2.0:1776191241.053829:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191241.053867:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006de4f7b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613787968:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 129us (624us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191241.053876:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2217
00010000:00010000:3.0:1776191241.210230:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191242.234244:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191242.492898:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000099f3d8e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630882112:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191242.492974:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191242.493173:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630882112
00000100:00100000:2.0:1776191242.493224:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3045
00000100:00100000:2.0:1776191242.493230:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd82c1e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630882112:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191242.493274:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191242.493324:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd82c1e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630882112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (351us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191242.493331:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3045
00000100:00100000:1.0:1776191242.493455:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000099f3d8e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630882112:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191243.258341:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191243.514287:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776191243.514314:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630882176:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191243.514387:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191243.517615:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630882176
00000100:00100000:3.0:1776191243.517664:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3046
00000100:00100000:3.0:1776191243.517671:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000418a6d34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630882176:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191243.517711:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191243.517787:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000418a6d34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630882176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (3400us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191243.517794:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3046
00000100:00100000:2.0:1776191243.518639:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630882176:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191244.282574:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191244.538928:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776191244.538947:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630882240:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191244.539013:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191244.540329:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630882240
00000100:00100000:0.0:1776191244.540407:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191244.540421:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003865af9a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630882304:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191244.540482:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191244.540514:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630882304
00000100:00100000:2.0:1776191244.540566:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1537
00000100:00100000:2.0:1776191244.540573:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030eda894 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630882304:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191244.540602:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191244.540646:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030eda894 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630882304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (164us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191244.540652:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1537
00000100:00100000:2.0:1776191244.540694:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003865af9a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630882304:0@lo:13:osp-pre-0-0.0
00000100:00080000:1.0:1776191244.541021:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191244.541027:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191244.541030:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1776191244.541051:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dcfa8951 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630882432:0@lo:400:kworker/u8:2.0
00000100:00080000:1.0:1776191244.541057:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3777
00000100:00080000:1.0:1776191244.541060:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191244.541064:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191244.541084:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191244.541099:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000000d20c9eb x1862467630882688/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191244.541115:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191244.541118:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191244.541119:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1776191244.541124:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00080000:1.0:1776191244.541124:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3777
00000100:00080000:1.0:1776191244.541128:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00100000:0.0:1776191244.541132:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002ae10efb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630882368:0@lo:400:kworker/u8:2.0
00000100:00080000:1.0:1776191244.541133:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191244.541151:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000911fdeb6 x1862467630882752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191244.541170:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191244.541188:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cec144c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630882624:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191244.541196:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000c128c04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630882560:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191244.541222:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191244.541246:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000301f1ca1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630882816:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191244.541247:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191244.541274:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191244.541275:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:1.0:1776191244.541283:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a2eb5de3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630882496:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191244.541311:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630882432
00000100:00100000:1.0:1776191244.541314:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191244.541335:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000070c80d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630882880:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191244.541345:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630882560
00000100:00100000:0.0:1776191244.541364:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630882816
00000100:00100000:1.0:1776191244.541372:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191244.541512:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000d20c9eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630882688:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191244.541816:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1538
00000100:00100000:3.0:1776191244.541822:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096baf6e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630882240:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191244.541843:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191244.541881:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096baf6e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630882240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (2869us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191244.541888:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1538
00000100:00100000:2.0:1776191244.544072:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191244.544104:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000911fdeb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630882752:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191244.544125:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191244.544168:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630882368
00000100:00100000:2.0:1776191244.544202:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1688
00000100:00100000:2.0:1776191244.544207:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f9005e31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630882368:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191244.544262:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f9005e31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630882368:12345-0@lo:400:kworker/u8:2.0 Request processed in 54us (3093us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191244.544269:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1688
00000100:00100000:2.0:1776191244.544301:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630882624
00000100:00100000:2.0:1776191244.544318:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630882496
00000100:00100000:2.0:1776191244.544327:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3047
00000100:00100000:2.0:1776191244.544331:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002982660c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630882624:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191244.544355:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002982660c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630882624:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (3146us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191244.544373:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3047
00000100:00100000:2.0:1776191244.544383:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3048
00000100:00100000:2.0:1776191244.544387:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002a035eb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630882496:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191244.544407:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002a035eb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630882496:12345-0@lo:400:kworker/u8:2.0 Request processed in 20us (3096us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191244.544412:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3048
00000100:00100000:2.0:1776191244.544456:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002ae10efb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630882368:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191244.544467:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cec144c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630882624:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191244.547723:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630882880
00000100:00100000:3.0:1776191244.547759:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4470
00000100:00100000:3.0:1776191244.547768:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003f98c5af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630882432:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191244.547778:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4471
00000100:00100000:0.0:1776191244.547785:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000321faac3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630882560:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191244.548888:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4472
00000100:00100000:1.0:1776191244.548896:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009240ac6a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630882816:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191244.549025:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003f98c5af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630882432:12345-0@lo:400:kworker/u8:2.0 Request processed in 1257us (7942us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191244.549052:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4470
00000100:00100000:0.0:1776191244.549072:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000321faac3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630882560:12345-0@lo:400:kworker/u8:2.0 Request processed in 1286us (7828us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191244.549078:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4473
00000100:00100000:0.0:1776191244.549087:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4471
00000100:00100000:3.0:1776191244.549097:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036447325 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630882880:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191244.549129:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036447325 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630882880:12345-0@lo:400:kworker/u8:2.0 Request processed in 44us (7758us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191244.549134:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4473
00000100:00100000:3.0:1776191244.549181:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dcfa8951 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630882432:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191244.549265:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630882688
00000100:00100000:3.0:1776191244.549297:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630882752
00000100:00100000:0.0:1776191244.549300:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2218
00000100:00100000:0.0:1776191244.549307:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a8c7923 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630882688:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191244.549316:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2219
00000100:00100000:3.0:1776191244.549321:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c02746a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630882752:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191244.549440:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191244.549477:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c02746a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630882752:12345-0@lo:8:kworker/u8:2.0 Request processed in 155us (5351us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191244.549483:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2219
00000100:00100000:3.0:1776191244.549514:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a2eb5de3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630882496:0@lo:400:kworker/u8:2.0
00010000:02020000:0.0:1776191244.549891:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191244.549938:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a8c7923 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630882688:12345-0@lo:8:kworker/u8:2.0 Request processed in 629us (5870us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191244.549945:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2218
00000100:00100000:3.0:1776191244.549953:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000070c80d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630882880:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191244.549977:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000c128c04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630882560:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191244.549997:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630882240:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1776191244.550096:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191244.550101:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191244.550104:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000d20c9eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630882688:0@lo:8:kworker/u8:2.0
00000100:00080000:3.0:1776191244.550114:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191244.550116:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191244.550119:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000911fdeb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630882752:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191244.550517:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009240ac6a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630882816:12345-0@lo:400:kworker/u8:2.0 Request processed in 1619us (9241us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191244.550535:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4472
00000100:00100000:3.0:1776191244.550795:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000301f1ca1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630882816:0@lo:400:kworker/u8:2.0
00010000:00010000:3.0:1776191245.308363:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191246.170998:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191246.171125:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191246.171152:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191246.171172:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191246.171202:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191246.171439:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613788032
00000100:00100000:1.0:1776191246.171487:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1689
00000100:00100000:1.0:1776191246.171493:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000961e9bab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613788032:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191246.171561:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000961e9bab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613788032:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 67us (437us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191246.171568:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1689
00000100:00100000:1.0:1776191246.171674:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613788160
00000100:00100000:1.0:1776191246.171699:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613788096
00000100:00100000:1.0:1776191246.171713:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4474
00000100:00100000:1.0:1776191246.171718:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000073716db5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613788160:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191246.171750:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000073716db5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613788160:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 32us (599us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191246.171757:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4474
00000100:00100000:1.0:1776191246.171769:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4475
00000100:00100000:1.0:1776191246.171773:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c6da23c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613788096:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191246.171794:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c6da23c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613788096:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 21us (622us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191246.171799:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4475
00000100:00100000:2.0:1776191246.171874:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613788288
00000100:00100000:2.0:1776191246.171913:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613788224
00000100:00100000:2.0:1776191246.171937:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1953
00000100:00100000:2.0:1776191246.171941:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001425031c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613788224:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191246.171967:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001425031c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613788224:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 25us (765us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191246.171973:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1953
00000100:00100000:2.0:1776191246.171984:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2220
00000100:00100000:2.0:1776191246.171987:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c5625d66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613788288:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:2.0:1776191246.172111:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191246.172135:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c5625d66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613788288:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 146us (1146us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191246.172141:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2220
00010000:00010000:3.0:1776191246.330633:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191247.354338:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191247.610336:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191247.610349:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a26e20f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630882944:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191247.610415:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191247.610518:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630882944
00000100:00100000:2.0:1776191247.610571:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3049
00000100:00100000:2.0:1776191247.610576:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000042f08b56 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630882944:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191247.610609:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191247.610668:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000042f08b56 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630882944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (254us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191247.610675:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3049
00000100:00100000:1.0:1776191247.611107:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a26e20f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630882944:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191248.379657:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191248.635716:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191248.635739:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a26e20f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630883008:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191248.635810:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191248.635900:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630883008
00000100:00100000:0.0:1776191248.635951:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3050
00000100:00100000:0.0:1776191248.635957:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000cbdfd62 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630883008:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191248.635990:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191248.636068:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000cbdfd62 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630883008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (259us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191248.636085:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3050
00000100:00100000:3.0:1776191248.636318:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a26e20f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630883008:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191249.403101:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1776191249.658373:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191249.658381:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191249.658385:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191249.658394:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3782
00000100:00080000:3.0:1776191249.658397:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191249.658403:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191249.658423:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000a34feed9 x1862467630883520/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191249.658438:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191249.658440:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191249.658442:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191249.658445:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3782
00000100:00080000:3.0:1776191249.658446:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191249.658449:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191249.658469:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000086c77a9e x1862467630883584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191249.658504:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a70c215b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630883264:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191249.658566:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191249.658592:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008cc5f0ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630883648:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191249.658616:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191249.658638:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [1->0]
00000100:00100000:3.0:1776191249.658644:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000074fc7059 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630883072:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191249.658676:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191249.658692:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000698fe8e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630883328:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191249.658703:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630883264
00000100:00100000:3.0:1776191249.658714:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191249.658729:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000424d0623 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630883712:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191249.658746:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630883648
00000100:00100000:3.0:1776191249.658751:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191249.658770:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630883712
00000100:00100000:3.0:1776191249.658778:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5d3af6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630883200:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191249.658806:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4476
00000100:00100000:3.0:1776191249.658806:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191249.658814:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000582e55fd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630883264:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191249.658823:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b5b887d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630883456:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191249.658848:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191249.658865:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [2->3]
00000100:00100000:3.0:1776191249.658871:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ed5180d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630883136:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191249.658892:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000582e55fd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630883264:12345-0@lo:400:kworker/u8:4.0 Request processed in 77us (326us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191249.658900:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191249.658903:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4476
00000100:00100000:3.0:1776191249.658922:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c345c5b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630883392:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191249.658923:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630883136
00000100:00100000:0.0:1776191249.658941:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4477
00000100:00100000:0.0:1776191249.658945:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008f95eebc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630883648:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191249.658952:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191249.658964:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f0579a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630883776:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191249.658987:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008f95eebc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630883648:12345-0@lo:400:kworker/u8:4.0 Request processed in 40us (371us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191249.658994:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191249.658997:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4477
00000100:00100000:0.0:1776191249.659012:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4478
00000100:00100000:0.0:1776191249.659017:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000023ddc3fa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630883712:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191249.659026:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a34feed9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630883520:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191249.659069:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000023ddc3fa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630883712:12345-0@lo:400:kworker/u8:4.0 Request processed in 51us (318us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191249.659079:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4478
00000100:00100000:3.0:1776191249.659083:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191249.659097:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086c77a9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630883584:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191249.659114:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4479
00000100:00100000:0.0:1776191249.659119:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f0cdd2b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630883136:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191249.659130:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191249.659173:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f0cdd2b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630883136:12345-0@lo:400:kworker/u8:4.0 Request processed in 52us (272us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191249.659180:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4479
00000100:00100000:3.0:1776191249.659211:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ed5180d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630883136:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191249.659237:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630883328
00000100:00100000:0.0:1776191249.659259:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630883200
00000100:00100000:3.0:1776191249.659271:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630883456
00000100:00100000:0.0:1776191249.659273:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3051
00000100:00100000:0.0:1776191249.659279:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009e49d076 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630883328:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191249.659303:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630883392
00000100:00100000:0.0:1776191249.659312:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009e49d076 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630883328:12345-0@lo:400:kworker/u8:4.0 Request processed in 32us (598us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191249.659319:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3051
00000100:00100000:3.0:1776191249.659324:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630883520
00000100:00100000:0.0:1776191249.659335:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3052
00000100:00100000:0.0:1776191249.659340:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049908ee0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630883200:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191249.659340:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630883584
00000100:00100000:3.0:1776191249.659354:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1954
00000100:00100000:3.0:1776191249.659359:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f2477cb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630883456:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191249.659374:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049908ee0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630883200:12345-0@lo:400:kworker/u8:4.0 Request processed in 33us (571us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191249.659380:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3052
00000100:00100000:3.0:1776191249.659405:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f2477cb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630883456:12345-0@lo:400:kworker/u8:4.0 Request processed in 44us (556us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191249.659412:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1954
00000100:00100000:0.0:1776191249.659414:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000698fe8e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630883328:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191249.659428:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000424d0623 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630883712:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191249.659432:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1955
00000100:00100000:3.0:1776191249.659438:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a9e71f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630883392:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191249.659442:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a70c215b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630883264:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191249.659452:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008cc5f0ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630883648:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191249.659472:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a9e71f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630883392:12345-0@lo:400:kworker/u8:4.0 Request processed in 32us (523us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191249.659480:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1955
00000100:00100000:0.0:1776191249.659496:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2221
00000100:00100000:0.0:1776191249.659502:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2e3dc1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630883520:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191249.659582:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630883776
00010000:02020000:0.0:1776191249.659592:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191249.659611:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1539
00000100:00100000:2.0:1776191249.659617:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001105f678 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630883776:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191249.659630:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2e3dc1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630883520:12345-0@lo:8:kworker/u8:4.0 Request processed in 127us (552us total) trans 0 rc -19/-19
00002000:00000024:2.0:1776191249.659638:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191249.659690:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630883072
00000100:00100000:1.0:1776191249.659716:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1690
00000100:00100000:1.0:1776191249.659720:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dce6a0d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630883072:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191249.659754:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dce6a0d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630883072:12345-0@lo:400:kworker/u8:4.0 Request processed in 34us (1079us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191249.659760:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1690
00000100:00100000:2.0:1776191249.659832:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001105f678 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630883776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 214us (839us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191249.659838:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1539
00000100:00100000:3.0:1776191249.659994:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2222
00000100:00100000:3.0:1776191249.659999:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029599f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630883584:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191249.660100:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191249.660133:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029599f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630883584:12345-0@lo:8:kworker/u8:4.0 Request processed in 133us (1005us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191249.660141:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2222
00000100:00100000:3.0:1776191249.660163:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1776191249.660171:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630883840:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191249.660195:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191249.660241:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c345c5b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630883392:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191249.660254:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f0579a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630883776:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191249.660265:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5d3af6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630883200:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191249.660271:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b5b887d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630883456:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191249.660308:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630883840
00000100:00100000:3.0:1776191249.660329:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1540
00000100:00100000:3.0:1776191249.660333:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004cf2553a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630883840:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191249.660343:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191249.660370:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004cf2553a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630883840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (175us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191249.660376:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1540
00000100:00100000:3.0:1776191249.660405:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630883840:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1776191249.660453:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191249.660457:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191249.660469:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a34feed9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630883520:0@lo:8:kworker/u8:4.0
00000100:00080000:3.0:1776191249.660478:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191249.660480:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191249.660482:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086c77a9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630883584:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191249.662735:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2221
00000100:00100000:0.0:1776191249.662836:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000074fc7059 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630883072:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191250.426606:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191251.296348:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191251.296417:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613788352
00000100:00100000:2.0:1776191251.296520:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1691
00000100:00100000:2.0:1776191251.296527:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd42e839 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613788352:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191251.296601:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd42e839 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613788352:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 74us (260us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191251.296609:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1691
00000100:00100000:3.0:1776191251.296943:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191251.297060:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613788416
00000100:00100000:1.0:1776191251.297168:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4480
00000100:00100000:1.0:1776191251.297173:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000838f908 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613788416:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191251.297211:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000838f908 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613788416:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 38us (270us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191251.297218:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4480
00000100:00100000:3.0:1776191251.298986:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191251.299026:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191251.299127:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191251.299161:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613788480
00000100:00100000:3.0:1776191251.299198:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4481
00000100:00100000:3.0:1776191251.299203:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002182deb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613788480:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191251.299257:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002182deb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613788480:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 53us (131us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191251.299264:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4481
00000100:00100000:2.0:1776191251.301245:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613788608
00000100:00100000:2.0:1776191251.301391:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613788544
00000100:00100000:0.0:1776191251.301864:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1956
00000100:00100000:0.0:1776191251.301872:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002cd3d4b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613788544:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191251.301952:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002cd3d4b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613788544:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 79us (2925us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191251.301959:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1956
00000100:00100000:0.0:1776191251.301977:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2223
00000100:00100000:0.0:1776191251.301981:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af44226e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613788608:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:0.0:1776191251.303915:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191251.303985:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af44226e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613788608:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 2002us (5003us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191251.303996:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2223
00010000:00010000:3.0:1776191251.450246:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191252.477394:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191252.730339:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191252.730365:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000099f3d8e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630883904:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191252.730442:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191252.730536:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630883904
00000100:00100000:2.0:1776191252.730589:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3053
00000100:00100000:2.0:1776191252.730594:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa41a1c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630883904:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191252.730634:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191252.730690:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa41a1c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630883904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (241us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191252.730696:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3053
00000100:00100000:1.0:1776191252.731188:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000099f3d8e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630883904:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191253.500123:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191253.759131:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776191253.759156:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008cc360bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630883968:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191253.759221:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191253.759324:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630883968
00000100:00100000:3.0:1776191253.759375:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3054
00000100:00100000:3.0:1776191253.759381:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000001330234 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630883968:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191253.759412:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191253.759457:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000001330234 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630883968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (237us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191253.759464:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3054
00000100:00100000:0.0:1776191253.759539:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008cc360bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630883968:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191254.522825:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1776191254.778888:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191254.778895:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191254.778898:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191254.778913:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3787
00000100:00080000:3.0:1776191254.778917:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191254.778923:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191254.778940:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000a5d3af6f x1862467630884480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191254.778955:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191254.778958:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191254.778959:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191254.778962:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3787
00000100:00080000:3.0:1776191254.778964:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191254.778967:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191254.778986:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000c345c5b9 x1862467630884544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191254.779030:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000074fc7059 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630884224:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191254.779112:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191254.779137:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008cc5f0ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630884608:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191254.779155:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191254.779171:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:3.0:1776191254.779176:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000042dcf5f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630884160:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191254.779198:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191254.779211:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b5b887d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630884416:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191254.779230:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191254.779260:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630884416
00000100:00100000:3.0:1776191254.779304:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1957
00000100:00100000:3.0:1776191254.779310:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000994ca5e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630884416:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191254.779359:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000994ca5e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630884416:12345-0@lo:400:kworker/u8:4.0 Request processed in 48us (128us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191254.779366:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1957
00000100:00100000:3.0:1776191254.779404:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b5b887d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630884416:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191254.779426:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630884224
00000100:00100000:3.0:1776191254.779447:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630884608
00000100:00100000:3.0:1776191254.779464:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4482
00000100:00100000:3.0:1776191254.779467:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000424d0623 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630884224:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191254.779499:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000424d0623 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630884224:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (390us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191254.779505:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4482
00000100:00100000:3.0:1776191254.779515:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4483
00000100:00100000:3.0:1776191254.779519:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000698fe8e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630884608:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191254.779541:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000698fe8e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630884608:12345-0@lo:400:kworker/u8:4.0 Request processed in 21us (385us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191254.779546:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4483
00000100:00100000:3.0:1776191254.779566:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000160230d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630884032:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191254.779592:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191254.779608:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086c77a9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630884288:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191254.779628:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191254.779640:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a70c215b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630884672:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191254.779658:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191254.779673:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:3.0:1776191254.779678:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000049979283 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630884096:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191254.779697:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191254.779709:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a34feed9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630884352:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191254.779727:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191254.779749:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630884032
00000100:00100000:3.0:1776191254.779773:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1692
00000100:00100000:3.0:1776191254.779777:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002224990e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630884032:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191254.779806:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002224990e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630884032:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (213us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191254.779811:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1692
00000100:00100000:3.0:1776191254.779837:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630884352
00000100:00100000:3.0:1776191254.779855:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1958
00000100:00100000:3.0:1776191254.779859:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008b7326a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630884352:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191254.779886:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008b7326a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630884352:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (159us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191254.779891:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1958
00000100:00100000:3.0:1776191254.779905:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630884672
00000100:00100000:3.0:1776191254.779924:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630884096
00000100:00100000:3.0:1776191254.779938:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4484
00000100:00100000:3.0:1776191254.779942:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f06a876 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630884672:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191254.779968:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f06a876 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630884672:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (310us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191254.779973:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4484
00000100:00100000:3.0:1776191254.779983:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4485
00000100:00100000:3.0:1776191254.779986:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000023cc91bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630884096:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191254.780024:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000023cc91bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630884096:12345-0@lo:400:kworker/u8:4.0 Request processed in 37us (327us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191254.780030:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4485
00000100:00100000:3.0:1776191254.780094:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000074fc7059 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630884224:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191254.780103:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008cc5f0ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630884608:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191254.780123:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5d3af6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630884480:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191254.780145:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191254.780159:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c345c5b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630884544:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191254.780178:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191254.780201:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630884480
00000100:00100000:3.0:1776191254.780216:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630884544
00000100:00100000:3.0:1776191254.780228:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2224
00000100:00100000:3.0:1776191254.780231:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000060360b30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630884480:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191254.780326:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191254.780356:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000060360b30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630884480:12345-0@lo:8:kworker/u8:4.0 Request processed in 123us (211us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191254.780362:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2224
00000100:00100000:3.0:1776191254.780372:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2225
00000100:00100000:3.0:1776191254.780375:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006c1f8cff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630884544:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191254.780453:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191254.780475:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006c1f8cff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630884544:12345-0@lo:8:kworker/u8:4.0 Request processed in 98us (296us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191254.780480:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2225
00000100:00100000:3.0:1776191254.780507:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000049979283 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630884096:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191254.780516:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a34feed9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630884352:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191254.780524:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000160230d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630884032:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191254.780532:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a70c215b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630884672:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191254.780558:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630884160
00000100:00100000:3.0:1776191254.780575:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630884288
00000100:00100000:3.0:1776191254.780586:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3055
00000100:00100000:3.0:1776191254.780590:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ed5180d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630884160:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191254.780621:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ed5180d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630884160:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (1423us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191254.780627:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3055
00000100:00100000:3.0:1776191254.780637:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3056
00000100:00100000:3.0:1776191254.780641:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000011eb3cbb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630884288:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191254.780667:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000011eb3cbb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630884288:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (1039us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191254.780672:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3056
00000100:00100000:3.0:1776191254.780692:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000042dcf5f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630884160:0@lo:400:kworker/u8:4.0
00000100:00080000:3.0:1776191254.780712:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191254.780715:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191254.780718:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5d3af6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630884480:0@lo:8:kworker/u8:4.0
00000100:00080000:3.0:1776191254.780725:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191254.780727:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191254.780729:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c345c5b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630884544:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191254.780749:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086c77a9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630884288:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191254.780910:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191254.780918:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630884736:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191254.780945:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191254.780972:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630884736
00000100:00100000:0.0:1776191254.781010:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1541
00000100:00100000:0.0:1776191254.781015:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d68d7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630884736:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191254.781064:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191254.781095:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d68d7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630884736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (149us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191254.781100:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1541
00000100:00100000:0.0:1776191254.781128:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630884736:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191254.781331:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1776191254.781339:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630884800:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191254.781364:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191254.781387:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630884800
00000100:00100000:2.0:1776191254.781409:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1542
00000100:00100000:2.0:1776191254.781412:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4fb1a2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630884800:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191254.781425:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191254.781453:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4fb1a2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630884800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (88us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191254.781460:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1542
00000100:00100000:2.0:1776191254.781485:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630884800:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1776191255.547877:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191256.411495:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191256.411587:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191256.411621:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191256.411647:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191256.411674:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191256.411707:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613788736
00000100:00100000:3.0:1776191256.411751:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4486
00000100:00100000:3.0:1776191256.411757:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c82f0bae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613788736:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191256.411825:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c82f0bae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613788736:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 67us (339us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191256.411832:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4486
00000100:00100000:3.0:1776191256.411850:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613788800
00000100:00100000:3.0:1776191256.411870:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4487
00000100:00100000:3.0:1776191256.411874:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000000a829dc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613788800:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191256.411898:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000000a829dc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613788800:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 23us (251us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191256.411903:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4487
00000100:00100000:3.0:1776191256.411920:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613788864
00000100:00100000:3.0:1776191256.411940:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613788928
00000100:00100000:3.0:1776191256.411967:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1959
00000100:00100000:3.0:1776191256.411972:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb1d57ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613788864:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191256.411996:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb1d57ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613788864:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 24us (410us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191256.412002:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1959
00000100:00100000:3.0:1776191256.412014:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2226
00000100:00100000:3.0:1776191256.412018:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003f01d2f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613788928:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00000100:00100000:1.0:1776191256.412808:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613788672
00000100:00100000:1.0:1776191256.412849:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1693
00000100:00100000:1.0:1776191256.412853:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e89cfd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613788672:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191256.412888:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e89cfd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613788672:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 34us (1267us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191256.412895:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1693
00010000:02020000:3.0:1776191256.413319:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191256.415276:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003f01d2f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613788928:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 3251us (3596us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191256.415298:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2226
00010000:00010000:3.0:1776191256.573289:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191257.594371:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191257.850465:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191257.850481:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630884864:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191257.850544:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191257.850631:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630884864
00000100:00100000:2.0:1776191257.850679:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3057
00000100:00100000:2.0:1776191257.850685:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004da0b0e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630884864:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191257.850715:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191257.850765:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004da0b0e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630884864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (222us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191257.850771:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3057
00000100:00100000:3.0:1776191257.850944:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630884864:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191258.618272:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191258.874926:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1776191258.874944:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630884928:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191258.875023:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191258.875328:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630884928
00000100:00100000:1.0:1776191258.875385:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3058
00000100:00100000:1.0:1776191258.875391:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000cd64c98 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630884928:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191258.875422:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191258.875672:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000cd64c98 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630884928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 280us (651us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191258.875680:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3058
00000100:00100000:3.0:1776191258.875858:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630884928:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191259.642791:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191259.898455:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b9f58501 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630884992:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191259.898528:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191259.898760:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630884992
00000100:00100000:3.0:1776191259.898806:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1543
00000100:00100000:3.0:1776191259.898811:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008cc360bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630884992:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191259.898841:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191259.898897:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008cc360bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630884992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (370us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191259.898905:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1543
00000100:00100000:3.0:1776191259.898951:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b9f58501 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630884992:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191259.899122:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191259.899131:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630885056:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191259.899161:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191259.899186:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630885056
00000100:00100000:0.0:1776191259.899209:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1544
00000100:00100000:0.0:1776191259.899213:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ef9b9d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630885056:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191259.899224:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191259.899251:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ef9b9d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630885056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (91us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191259.899256:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1544
00000100:00100000:0.0:1776191259.899286:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630885056:0@lo:13:osp-pre-0-0.0
00000100:00080000:1.0:1776191259.900214:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191259.900219:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191259.900222:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191259.900227:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3792
00000100:00080000:1.0:1776191259.900230:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191259.900234:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191259.900252:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000cb97b35c x1862467630885440/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191259.900266:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191259.900269:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191259.900270:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191259.900273:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3792
00000100:00080000:1.0:1776191259.900275:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191259.900278:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191259.900286:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000057cf3599 x1862467630885504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191259.900322:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005fa5d8be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630885184:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191259.900361:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191259.900382:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003f3f309a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630885568:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191259.900401:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191259.900418:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:1.0:1776191259.900424:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004a57869 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630885248:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191259.900463:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191259.900478:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a3b02dc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630885632:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191259.900496:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191259.900522:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630885184
00000100:00100000:1.0:1776191259.900550:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630885568
00000100:00100000:1.0:1776191259.900563:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630885632
00000100:00100000:1.0:1776191259.900592:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4488
00000100:00100000:1.0:1776191259.900597:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c477a6c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630885184:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191259.900638:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c477a6c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630885184:12345-0@lo:400:kworker/u8:2.0 Request processed in 41us (278us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191259.900644:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4488
00000100:00100000:1.0:1776191259.900658:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4489
00000100:00100000:1.0:1776191259.900660:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000254994e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630885568:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191259.900685:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000254994e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630885568:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (284us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191259.900690:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4489
00000100:00100000:1.0:1776191259.900702:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4490
00000100:00100000:1.0:1776191259.900706:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a79a08f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630885632:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191259.900728:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a79a08f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630885632:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (232us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191259.900734:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4490
00000100:00100000:1.0:1776191259.900751:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630885248
00000100:00100000:1.0:1776191259.900770:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3059
00000100:00100000:1.0:1776191259.900773:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b4675f7b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630885248:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191259.900799:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b4675f7b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630885248:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (337us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191259.900805:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3059
00000100:00100000:1.0:1776191259.901187:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004a57869 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630885248:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191259.901197:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a3b02dc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630885632:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191259.901204:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005fa5d8be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630885184:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191259.901212:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003f3f309a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630885568:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191259.901770:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb97b35c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630885440:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191259.901810:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191259.901839:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057cf3599 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630885504:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191259.901861:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191259.901914:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630885440
00000100:00100000:3.0:1776191259.901941:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630885504
00000100:00100000:3.0:1776191259.901956:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2227
00000100:00100000:3.0:1776191259.901960:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b9f58501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630885440:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191259.902101:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191259.902136:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b9f58501 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630885440:12345-0@lo:8:kworker/u8:2.0 Request processed in 175us (326us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191259.902143:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2227
00000100:00100000:3.0:1776191259.902155:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2228
00000100:00100000:3.0:1776191259.902159:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000170cab4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630885504:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191259.902242:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191259.902263:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000170cab4e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630885504:12345-0@lo:8:kworker/u8:2.0 Request processed in 103us (401us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191259.902268:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2228
00000100:00080000:3.0:1776191259.902425:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191259.902429:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191259.902433:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb97b35c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630885440:0@lo:8:kworker/u8:2.0
00000100:00080000:3.0:1776191259.902439:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191259.902574:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191259.902578:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057cf3599 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630885504:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191259.902964:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d10ef768 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630885120:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191259.903014:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191259.903068:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000542b51d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630885376:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191259.903149:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191259.903167:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191259.903172:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000250a4bd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630885312:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191259.903194:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191259.903220:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630885312
00000100:00100000:0.0:1776191259.903250:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4491
00000100:00100000:0.0:1776191259.903254:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004b61d099 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630885312:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191259.903294:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004b61d099 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630885312:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (100us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191259.903300:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4491
00000100:00100000:0.0:1776191259.903331:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000250a4bd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630885312:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191259.903476:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630885120
00000100:00100000:2.0:1776191259.903511:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1694
00000100:00100000:2.0:1776191259.903515:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f3625dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630885120:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191259.903552:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f3625dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630885120:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (538us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191259.903558:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1694
00000100:00100000:0.0:1776191259.904118:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d10ef768 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630885120:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191259.905644:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630885376
00000100:00100000:3.0:1776191259.905707:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3060
00000100:00100000:3.0:1776191259.905713:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000128cb0b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630885376:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191259.905790:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000128cb0b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630885376:12345-0@lo:400:kworker/u8:2.0 Request processed in 76us (2641us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191259.905796:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3060
00000100:00100000:0.0:1776191259.906733:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000542b51d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630885376:0@lo:400:kworker/u8:2.0
00010000:00010000:3.0:1776191260.666706:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191261.533829:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191261.533932:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191261.533957:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191261.534309:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613789056
00000100:00100000:3.0:1776191261.534377:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4492
00000100:00100000:3.0:1776191261.534384:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000099f3d8e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613789056:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191261.534449:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000099f3d8e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613789056:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 65us (517us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191261.534457:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4492
00000100:00100000:0.0:1776191261.542171:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613788992
00000100:00100000:0.0:1776191261.542237:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1695
00000100:00100000:0.0:1776191261.542243:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e270043d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613788992:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191261.542409:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e270043d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613788992:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 165us (8587us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191261.542417:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1695
00000100:00100000:1.0:1776191261.545074:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613789184
00000100:00100000:1.0:1776191261.545150:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1960
00000100:00100000:1.0:1776191261.545157:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ec42a12f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613789184:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191261.545226:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ec42a12f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613789184:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 69us (11268us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191261.545234:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1960
00000100:00100000:1.0:1776191261.559390:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191261.559476:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191261.559680:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613789120
00000100:00100000:2.0:1776191261.559740:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4493
00000100:00100000:2.0:1776191261.559747:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003f3f309a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613789120:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191261.559827:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003f3f309a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613789120:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 79us (444us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191261.559835:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4493
00000100:00100000:3.0:1776191261.560071:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613789248
00000100:00100000:3.0:1776191261.560096:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2229
00000100:00100000:3.0:1776191261.560100:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005fa5d8be pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613789248:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:3.0:1776191261.560192:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191261.560222:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005fa5d8be pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613789248:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 121us (746us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191261.560227:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2229
00010000:00010000:3.0:1776191261.690457:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191262.716275:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191262.970341:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a26e20f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630885696:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191262.970405:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191262.970504:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630885696
00000100:00100000:2.0:1776191262.970553:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3061
00000100:00100000:2.0:1776191262.970559:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005d07f501 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630885696:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191262.970590:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191262.970639:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005d07f501 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630885696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (234us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191262.970646:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3061
00000100:00100000:0.0:1776191262.970843:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a26e20f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630885696:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191263.743004:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191263.997525:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a26e20f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630885760:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191263.997594:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191263.997732:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630885760
00000100:00100000:3.0:1776191263.997791:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3062
00000100:00100000:3.0:1776191263.997805:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe1c3a77 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630885760:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191263.997838:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191263.997888:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe1c3a77 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630885760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (295us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191263.997894:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3062
00000100:00100000:0.0:1776191263.997970:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a26e20f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630885760:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191264.762360:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191265.018266:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004a57869 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630885952:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191265.018334:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191265.018435:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a3b02dc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630885888:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191265.018468:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191265.018488:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191265.018493:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000994ca5e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630885824:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191265.018514:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191265.018546:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630885952
00000100:00100000:0.0:1776191265.018593:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4494
00000100:00100000:0.0:1776191265.018599:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008b7326a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630885952:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191265.018745:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630885824
00000100:00100000:2.0:1776191265.018791:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1545
00000100:00100000:2.0:1776191265.018795:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c634116b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630885824:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191265.018818:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191265.019222:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c634116b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630885824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 425us (707us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191265.019230:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1545
00000100:00100000:2.0:1776191265.019253:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630885888
00000100:00100000:2.0:1776191265.019276:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1696
00000100:00100000:2.0:1776191265.019279:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fecbd6f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630885888:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191265.019309:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fecbd6f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630885888:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (840us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191265.019314:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1696
00000100:00100000:2.0:1776191265.019361:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a035eb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630886016:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191265.019397:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191265.019422:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630886016
00000100:00100000:2.0:1776191265.019443:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3063
00000100:00100000:2.0:1776191265.019447:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009df06d88 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630886016:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191265.019477:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009df06d88 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630886016:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (81us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191265.019483:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3063
00000100:00100000:2.0:1776191265.019510:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a035eb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630886016:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191265.019568:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000994ca5e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630885824:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191265.019577:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a3b02dc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630885888:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191265.019589:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1776191265.019594:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f6732c2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630886080:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191265.019615:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191265.019637:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630886080
00000100:00100000:2.0:1776191265.019658:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1546
00000100:00100000:2.0:1776191265.019661:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000808245d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630886080:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191265.019672:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191265.019700:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000808245d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630886080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (84us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191265.019706:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1546
00000100:00100000:2.0:1776191265.019731:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f6732c2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630886080:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191265.027536:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008b7326a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630885952:12345-0@lo:400:kworker/u8:2.0 Request processed in 8927us (9194us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191265.027552:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4494
00000100:00100000:3.0:1776191265.033934:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004a57869 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630885952:0@lo:400:kworker/u8:2.0
00000100:00080000:1.0:1776191265.034204:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191265.034210:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191265.034213:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191265.034218:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3797
00000100:00080000:1.0:1776191265.034220:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191265.034224:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191265.034242:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000841b9634 x1862467630886272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191265.034256:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191265.034258:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191265.034259:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191265.034262:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3797
00000100:00080000:1.0:1776191265.034263:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191265.034266:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191265.034275:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000038340710 x1862467630886336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191265.034316:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000841b9634 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630886272:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191265.034439:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa41a1c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630886144:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191265.034480:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191265.034507:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1776191265.034512:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba9731d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630886464:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191265.034532:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191265.034563:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630886144
00000100:00100000:2.0:1776191265.034612:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630886464
00000100:00100000:2.0:1776191265.034632:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4495
00000100:00100000:2.0:1776191265.034637:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f6732c2c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630886144:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191265.034681:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f6732c2c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630886144:12345-0@lo:400:kworker/u8:2.0 Request processed in 43us (201us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191265.034688:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4495
00000100:00100000:2.0:1776191265.034703:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4496
00000100:00100000:2.0:1776191265.034706:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f76e3cf5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630886464:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191265.034728:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f76e3cf5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630886464:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (196us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191265.034733:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4496
00000100:00100000:2.0:1776191265.034756:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba9731d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630886464:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191265.034763:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa41a1c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630886144:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191265.034813:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c4e82865 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630886400:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191265.034835:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191265.034858:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1776191265.034863:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da0b0e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630886208:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191265.034884:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191265.034908:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630886208
00000100:00100000:2.0:1776191265.034931:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3064
00000100:00100000:2.0:1776191265.034934:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c02746a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630886208:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191265.034964:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c02746a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630886208:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (80us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191265.034970:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3064
00000100:00100000:2.0:1776191265.034992:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da0b0e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630886208:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191265.035008:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630886400
00000100:00100000:2.0:1776191265.035030:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4497
00000100:00100000:2.0:1776191265.035051:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000751b578a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630886400:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191265.035081:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000751b578a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630886400:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (246us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191265.035087:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4497
00000100:00100000:2.0:1776191265.035109:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c4e82865 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630886400:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191265.035530:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191265.035557:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000038340710 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630886336:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191265.035649:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630886272
00000100:00100000:0.0:1776191265.035684:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2230
00000100:00100000:0.0:1776191265.035688:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048d62137 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630886272:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191265.035792:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191265.035826:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048d62137 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630886272:12345-0@lo:8:kworker/u8:2.0 Request processed in 137us (296us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191265.035832:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2230
00000100:00100000:1.0:1776191265.035974:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191265.036006:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191265.036010:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191265.036013:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000841b9634 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630886272:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191265.037076:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630886336
00000100:00100000:0.0:1776191265.037111:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2231
00000100:00100000:0.0:1776191265.037116:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000690142e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630886336:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191265.037208:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191265.037249:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000690142e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630886336:12345-0@lo:8:kworker/u8:2.0 Request processed in 133us (1275us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191265.037256:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2231
00000100:00080000:1.0:1776191265.037971:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191265.037976:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191265.037980:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000038340710 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630886336:0@lo:8:kworker/u8:2.0
00010000:00010000:3.0:1776191265.787703:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191266.651566:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191266.651608:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191266.651643:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191266.651669:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613789312
00000100:00100000:3.0:1776191266.651672:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191266.651694:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191266.651711:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1697
00000100:00100000:3.0:1776191266.651717:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613789504
00000100:00100000:0.0:1776191266.651728:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f7ed2aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613789312:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191266.651751:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613789568
00000100:00100000:3.0:1776191266.651767:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1961
00000100:00100000:3.0:1776191266.651771:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb1d57ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613789504:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191266.651800:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f7ed2aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613789312:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 82us (241us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191266.651800:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb1d57ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613789504:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 27us (127us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191266.651807:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1697
00000100:00100000:3.0:1776191266.651808:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1961
00000100:00100000:3.0:1776191266.651822:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2232
00000100:00100000:3.0:1776191266.651825:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003f01d2f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613789568:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:3.0:1776191266.651917:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191266.651942:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003f01d2f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613789568:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 115us (247us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191266.651948:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2232
00000100:00100000:1.0:1776191266.652126:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613789440
00000100:00100000:1.0:1776191266.652157:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613789376
00000100:00100000:1.0:1776191266.652174:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4498
00000100:00100000:1.0:1776191266.652179:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000060360b30 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613789440:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191266.652212:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000060360b30 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613789440:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 33us (604us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191266.652219:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4498
00000100:00100000:1.0:1776191266.652232:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4499
00000100:00100000:1.0:1776191266.652236:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006c1f8cff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613789376:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191266.652259:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006c1f8cff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613789376:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 22us (616us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191266.652264:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4499
00010000:00010000:3.0:1776191266.813445:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191267.834231:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191268.090328:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a8c7923 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630886528:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191268.090408:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191268.091379:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630886528
00000100:00100000:2.0:1776191268.091594:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3065
00000100:00100000:2.0:1776191268.091602:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000055aaefe0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630886528:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191268.091636:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191268.091701:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000055aaefe0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630886528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (1293us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191268.091783:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a8c7923 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630886528:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191268.095605:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3065
00010000:00010000:3.0:1776191268.858350:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191269.114514:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009189961c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630886592:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191269.114580:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191269.116213:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630886592
00000100:00100000:0.0:1776191269.116280:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3066
00000100:00100000:0.0:1776191269.116287:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b9f58501 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630886592:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191269.116320:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191269.120017:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b9f58501 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630886592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3723us (5430us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191269.120042:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3066
00000100:00100000:3.0:1776191269.120401:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009189961c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630886592:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191269.886500:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191270.138303:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776191270.138326:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000005f434a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630886656:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191270.138385:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006baa4949 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630886720:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1776191270.138408:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191270.138414:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191270.138417:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191270.138421:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3803
00000100:00080000:2.0:1776191270.138424:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191270.138430:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191270.138450:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000940c739a x1862467630887232/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191270.138459:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1776191270.138491:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1776191270.138494:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c82d865 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630886912:0@lo:400:kworker/u8:2.0
00000100:00080000:2.0:1776191270.138496:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191270.138499:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191270.138503:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3803
00000100:00080000:2.0:1776191270.138505:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191270.138509:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191270.138522:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000009189961c x1862467630887296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191270.138533:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191270.138561:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000418a6d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630887168:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191270.138590:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191270.141416:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000df87de4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630886784:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191270.142001:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003b6ef48d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630886976:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191270.142052:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191270.142075:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a8c7923 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630887360:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191270.142095:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191270.142105:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191270.142112:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004f22abe6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630887040:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191270.142135:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191270.142147:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630887232:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191270.142151:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a26e20f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630887424:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191270.142167:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191270.142194:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630886912
00000100:00100000:3.0:1776191270.142194:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630887040
00000100:00100000:1.0:1776191270.142239:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3067
00000100:00100000:3.0:1776191270.142243:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3068
00000100:00100000:1.0:1776191270.142245:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ea65731 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630886912:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191270.142246:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000551a670c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630887040:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191270.142289:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ea65731 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630886912:12345-0@lo:400:kworker/u8:2.0 Request processed in 43us (3757us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191270.142290:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000551a670c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630887040:12345-0@lo:400:kworker/u8:2.0 Request processed in 43us (155us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191270.142296:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3068
00000100:00100000:3.0:1776191270.142317:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630886976
00000100:00100000:3.0:1776191270.142339:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630887360
00000100:00100000:3.0:1776191270.142354:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630887424
00000100:00100000:3.0:1776191270.142371:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4500
00000100:00100000:3.0:1776191270.142374:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000841b9634 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630886976:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191270.142528:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000841b9634 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630886976:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (373us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191270.142536:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4500
00000100:00100000:3.0:1776191270.142549:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4501
00000100:00100000:3.0:1776191270.142552:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c243e42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630887360:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191270.142678:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c243e42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630887360:12345-0@lo:400:kworker/u8:2.0 Request processed in 125us (572us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191270.142683:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4501
00000100:00100000:3.0:1776191270.142694:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4502
00000100:00100000:3.0:1776191270.142698:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f001d003 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630887424:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191270.142720:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f001d003 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630887424:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (552us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191270.142726:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4502
00000100:00100000:3.0:1776191270.142755:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630886720
00000100:00100000:3.0:1776191270.142774:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1547
00000100:00100000:3.0:1776191270.142778:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000038340710 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630886720:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191270.142797:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191270.142822:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000038340710 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630886720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (4378us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191270.142828:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1547
00000100:00100000:3.0:1776191270.142859:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003b6ef48d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630886976:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191270.142869:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a8c7923 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630887360:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191270.142882:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006baa4949 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630886720:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191270.142916:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004f22abe6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630887040:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191270.142924:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a26e20f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630887424:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191270.145073:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3067
00000100:00100000:0.0:1776191270.145359:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c82d865 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630886912:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191270.145374:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:0.0:1776191270.145383:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000161dca59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630886848:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191270.145424:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191270.145438:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191270.145453:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007c94492b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630887104:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191270.145473:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191270.145505:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630887168
00000100:00100000:2.0:1776191270.145528:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630886784
00000100:00100000:0.0:1776191270.145541:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630887232
00000100:00100000:2.0:1776191270.145566:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1698
00000100:00100000:2.0:1776191270.145573:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000328cc67f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630886784:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191270.145577:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630887104
00000100:00100000:0.0:1776191270.145599:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1962
00000100:00100000:0.0:1776191270.145604:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000455a3f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630887168:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191270.145604:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009189961c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630887296:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191270.145635:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000328cc67f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630886784:12345-0@lo:400:kworker/u8:2.0 Request processed in 61us (3539us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191270.145642:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1698
00000100:00100000:2.0:1776191270.145681:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630886848
00000100:00100000:2.0:1776191270.145705:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4503
00000100:00100000:2.0:1776191270.145708:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b824a572 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630886848:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191270.145732:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191270.145758:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630887296
00000100:00100000:1.0:1776191270.145772:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1963
00000100:00100000:1.0:1776191270.145775:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2988da5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630887104:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191270.145862:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b824a572 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630886848:12345-0@lo:400:kworker/u8:2.0 Request processed in 151us (422us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191270.145864:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2988da5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630887104:12345-0@lo:400:kworker/u8:2.0 Request processed in 85us (388us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191270.145876:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4503
00000100:00100000:1.0:1776191270.145877:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1963
00000100:00100000:1.0:1776191270.145898:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2233
00000100:00100000:1.0:1776191270.145901:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c904ec5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630887232:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191270.145946:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000455a3f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630887168:12345-0@lo:400:kworker/u8:2.0 Request processed in 341us (7355us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191270.145952:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1962
00000100:00100000:0.0:1776191270.145963:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2234
00000100:00100000:0.0:1776191270.145966:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4e82865 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630887296:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:1.0:1776191270.146007:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191270.146055:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c904ec5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630887232:12345-0@lo:8:kworker/u8:2.0 Request processed in 153us (703us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191270.146061:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2233
00010000:02020000:0.0:1776191270.146076:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191270.146099:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4e82865 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630887296:12345-0@lo:8:kworker/u8:2.0 Request processed in 131us (369us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191270.146104:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2234
00000100:00100000:0.0:1776191270.146136:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000161dca59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630886848:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191270.146145:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007c94492b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630887104:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191270.146153:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000418a6d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630887168:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191270.146185:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191270.146332:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191270.146337:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191270.146340:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630887232:0@lo:8:kworker/u8:2.0
00000100:00080000:1.0:1776191270.146350:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1776191270.146418:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000df87de4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630886784:0@lo:400:kworker/u8:2.0
00000100:00080000:1.0:1776191270.146423:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191270.146424:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630886656
00000100:00100000:1.0:1776191270.146429:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009189961c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630887296:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191270.146459:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1548
00000100:00100000:3.0:1776191270.146462:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000042aec8a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630886656:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191270.146477:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191270.146517:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000042aec8a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630886656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (332us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191270.146523:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1548
00000100:00100000:2.0:1776191270.146852:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000005f434a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630886656:0@lo:13:osp-pre-0-0.0
00010000:00010000:3.0:1776191270.908748:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191271.770492:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191271.770597:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191271.770650:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191271.770675:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613789824
00000100:00100000:3.0:1776191271.770679:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191271.770707:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613789632
00000100:00100000:0.0:1776191271.770730:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1964
00000100:00100000:0.0:1776191271.770738:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036dae86d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613789824:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191271.770746:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1699
00000100:00100000:2.0:1776191271.770754:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019aa1469 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613789632:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191271.770808:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036dae86d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613789824:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 69us (211us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191271.770810:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019aa1469 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613789632:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 53us (159us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191271.770820:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1964
00000100:00100000:2.0:1776191271.770824:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1699
00000100:00100000:3.0:1776191271.774952:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191271.775168:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613789888
00000100:00100000:0.0:1776191271.775204:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2235
00000100:00100000:0.0:1776191271.775210:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000481c290f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613789888:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00000100:00100000:1.0:1776191271.775263:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613789696
00000100:00100000:1.0:1776191271.775306:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613789760
00010000:02020000:0.0:1776191271.775310:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191271.775329:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4504
00000100:00100000:1.0:1776191271.775334:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006baa4949 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613789696:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191271.775367:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000481c290f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613789888:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 155us (421us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191271.775374:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2235
00000100:00100000:1.0:1776191271.775378:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006baa4949 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613789696:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 41us (4892us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191271.775386:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4504
00000100:00100000:1.0:1776191271.775407:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4505
00000100:00100000:1.0:1776191271.775412:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008291e08d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613789760:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191271.775435:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008291e08d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613789760:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 23us (4758us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191271.775440:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4505
00010000:00010000:3.0:1776191271.930311:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191272.955029:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191273.210445:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000005f434a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630887488:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191273.210517:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191273.210873:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630887488
00000100:00100000:1.0:1776191273.210933:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3069
00000100:00100000:1.0:1776191273.210940:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002982660c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630887488:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191273.210972:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191273.211100:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000005f434a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630887488:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191273.216907:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002982660c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630887488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5958us (6382us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191273.216923:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3069
00010000:00010000:3.0:1776191273.978490:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191274.234387:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000df87de4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630887552:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191274.234453:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191274.234527:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630887552
00000100:00100000:0.0:1776191274.234579:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3070
00000100:00100000:0.0:1776191274.234585:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004da0b0e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630887552:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191274.234616:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191274.237872:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004da0b0e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630887552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3279us (3412us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191274.237887:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3070
00000100:00100000:1.0:1776191274.238681:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000df87de4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630887552:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191275.002797:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1776191275.258643:0:16146:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191275.258650:0:16146:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191275.258653:0:16146:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191275.258660:0:16146:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3808
00000100:00100000:3.0:1776191275.258661:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000042f08b56 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630887616:0@lo:13:osp-pre-0-0.0
00000100:00080000:1.0:1776191275.258663:0:16146:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191275.258668:0:16146:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191275.258685:0:16146:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000250a4bd2 x1862467630888128/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191275.258699:0:16146:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191275.258702:0:16146:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191275.258703:0:16146:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191275.258706:0:16146:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3808
00000100:00080000:1.0:1776191275.258708:0:16146:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191275.258710:0:16146:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191275.258719:0:16146:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000057cf3599 x1862467630888192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191275.258725:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191275.258755:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa41a1c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630887680:0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191275.258774:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba9731d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630887744:0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191275.258781:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191275.258794:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a035eb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630887936:0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191275.258802:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191275.258812:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191275.258816:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000542b51d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630888000:0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191275.258827:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007bb93380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630888320:0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191275.258836:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191275.258842:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191275.262883:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630887616
00000100:00100000:1.0:1776191275.262902:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004a57869 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630887808:0@lo:400:kworker/u8:0.0
00000100:00100000:0.0:1776191275.262945:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1549
00000100:00100000:0.0:1776191275.262950:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000994ca5e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630887616:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191275.262971:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00002000:00000024:0.0:1776191275.262978:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191275.262999:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d10ef768 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630888064:0@lo:400:kworker/u8:0.0
00000100:00100000:0.0:1776191275.263020:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000994ca5e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630887616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (4296us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191275.263023:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191275.263027:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1549
00000100:00100000:1.0:1776191275.263062:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:0.0:1776191275.263066:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630887680
00000100:00100000:1.0:1776191275.263069:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a3b02dc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630887872:0@lo:400:kworker/u8:0.0
00000100:00100000:0.0:1776191275.263090:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1700
00000100:00100000:1.0:1776191275.263092:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191275.263094:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe981ad6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630887680:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191275.263105:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb97b35c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630888256:0@lo:400:kworker/u8:0.0
00000100:00100000:0.0:1776191275.263122:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe981ad6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630887680:12345-0@lo:400:kworker/u8:0.0 Request processed in 27us (4340us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191275.263122:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191275.263127:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1700
00000100:00100000:1.0:1776191275.263149:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000250a4bd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630888128:0@lo:8:kworker/u8:0.0
00000100:00100000:0.0:1776191275.263153:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630887744
00000100:00100000:1.0:1776191275.263170:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191275.263174:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630888320
00000100:00100000:1.0:1776191275.263182:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057cf3599 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630888192:0@lo:8:kworker/u8:0.0
00000100:00100000:0.0:1776191275.263188:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4506
00000100:00100000:0.0:1776191275.263203:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df87de4e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630887744:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191275.263216:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191275.263229:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df87de4e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630887744:12345-0@lo:400:kworker/u8:0.0 Request processed in 38us (4427us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191275.263235:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4506
00000100:00100000:0.0:1776191275.263244:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630887872
00000100:00100000:1.0:1776191275.263244:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630887936
00000100:00100000:0.0:1776191275.263259:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630888256
00000100:00100000:1.0:1776191275.263263:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630887808
00000100:00100000:0.0:1776191275.263270:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4507
00000100:00100000:1.0:1776191275.263272:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3071
00000100:00100000:0.0:1776191275.263273:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000cd64c98 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630888320:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191275.263275:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000011eb3cbb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630887936:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:0.0:1776191275.263300:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000cd64c98 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630888320:12345-0@lo:400:kworker/u8:0.0 Request processed in 26us (4457us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191275.263300:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000011eb3cbb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630887936:12345-0@lo:400:kworker/u8:0.0 Request processed in 24us (4488us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191275.263306:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4507
00000100:00100000:1.0:1776191275.263306:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3071
00000100:00100000:1.0:1776191275.263316:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3072
00000100:00100000:0.0:1776191275.263317:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4508
00000100:00100000:0.0:1776191275.263320:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007bec6be8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630887872:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191275.263320:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016f04c4f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630887808:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191275.263728:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2477cb3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630888384:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191275.264683:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4509
00000100:00100000:3.0:1776191275.264698:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009fbbc7a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630888256:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:0.0:1776191275.264800:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007bec6be8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630887872:12345-0@lo:400:kworker/u8:0.0 Request processed in 1479us (1707us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191275.264808:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4508
00000100:00100000:1.0:1776191275.264819:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016f04c4f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630887808:12345-0@lo:400:kworker/u8:0.0 Request processed in 1497us (1847us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191275.264826:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3072
00000100:00100000:0.0:1776191275.264842:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630888000
00000100:00100000:1.0:1776191275.264848:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630888064
00000100:00100000:0.0:1776191275.264877:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630888128
00000100:00100000:2.0:1776191275.264894:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191275.264933:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba9731d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630887744:0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191275.264974:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630888384
00000100:00100000:2.0:1776191275.264997:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1550
00000100:00100000:2.0:1776191275.265001:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009189961c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630888384:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191275.265015:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191275.267410:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009189961c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630888384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2401us (2509us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191275.267425:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1550
00000100:00100000:2.0:1776191275.268651:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2477cb3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630888384:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191275.268792:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630888192
00000100:00100000:1.0:1776191275.268824:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1965
00000100:00100000:1.0:1776191275.268831:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000005f434a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630888000:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191275.268904:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000005f434a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630888000:12345-0@lo:400:kworker/u8:0.0 Request processed in 73us (10067us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191275.268914:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1965
00000100:00100000:1.0:1776191275.268929:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1966
00000100:00100000:1.0:1776191275.268934:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003bea0498 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630888064:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191275.268962:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003bea0498 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630888064:12345-0@lo:400:kworker/u8:0.0 Request processed in 29us (5939us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191275.268968:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1966
00000100:00100000:1.0:1776191275.268981:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2236
00000100:00100000:1.0:1776191275.268984:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba5b492f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630888128:12345-0@lo:8:kworker/u8:0.0
00010000:02020000:1.0:1776191275.269108:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191275.269142:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba5b492f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630888128:12345-0@lo:8:kworker/u8:0.0 Request processed in 157us (5972us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191275.269149:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2236
00000100:00100000:1.0:1776191275.269161:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2237
00000100:00100000:1.0:1776191275.269164:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b93c82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630888192:12345-0@lo:8:kworker/u8:0.0
00010000:02020000:1.0:1776191275.269256:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191275.269282:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b93c82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630888192:12345-0@lo:8:kworker/u8:0.0 Request processed in 116us (6065us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191275.269288:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2237
00000100:00100000:1.0:1776191275.269329:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000542b51d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630888000:0@lo:400:kworker/u8:0.0
00000100:00080000:1.0:1776191275.269360:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191275.269364:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191275.269367:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000250a4bd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630888128:0@lo:8:kworker/u8:0.0
00000100:00080000:1.0:1776191275.269376:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191275.269379:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191275.269381:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057cf3599 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630888192:0@lo:8:kworker/u8:0.0
00000100:00100000:1.0:1776191275.269408:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a3b02dc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630887872:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191275.269418:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004a57869 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630887808:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191275.269428:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d10ef768 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630888064:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191275.269512:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007bb93380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630888320:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191275.269530:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000042f08b56 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630887616:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191275.269538:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009fbbc7a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630888256:12345-0@lo:400:kworker/u8:0.0 Request processed in 4841us (6412us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191275.269544:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa41a1c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630887680:0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191275.269564:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4509
00000100:00100000:1.0:1776191275.269570:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a035eb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630887936:0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191275.269604:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb97b35c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630888256:0@lo:400:kworker/u8:0.0
00010000:00010000:3.0:1776191276.027238:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191276.897699:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191276.897749:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191276.897783:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191276.897804:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191276.897832:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191276.897874:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613790080
00000100:00100000:1.0:1776191276.897919:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613790016
00000100:00100000:1.0:1776191276.897938:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4510
00000100:00100000:1.0:1776191276.897944:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000673f0db9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613790080:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191276.898025:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000673f0db9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613790080:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 80us (241us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191276.898053:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4510
00000100:00100000:1.0:1776191276.898071:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4511
00000100:00100000:1.0:1776191276.898078:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000115a47cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613790016:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191276.898103:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000115a47cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613790016:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 26us (299us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191276.898110:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4511
00000100:00100000:0.0:1776191276.901597:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613790208
00000100:00100000:0.0:1776191276.901656:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613790144
00000100:00100000:0.0:1776191276.901698:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1967
00000100:00100000:0.0:1776191276.901704:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba29c9bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613790144:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191276.901784:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba29c9bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613790144:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 79us (3952us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191276.901792:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1967
00000100:00100000:0.0:1776191276.901813:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2238
00000100:00100000:0.0:1776191276.901819:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007bb93380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613790208:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:0.0:1776191276.901913:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191276.901941:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007bb93380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613790208:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 122us (4251us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191276.901946:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2238
00000100:00100000:3.0:1776191276.902136:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613789952
00000100:00100000:3.0:1776191276.902372:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1701
00000100:00100000:3.0:1776191276.902377:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001479089e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613789952:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191276.902422:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001479089e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613789952:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 44us (4673us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191276.902429:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1701
00010000:00010000:3.0:1776191277.051938:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191278.074820:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191278.331061:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630888448:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191278.331138:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191278.331242:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630888448
00000100:00100000:0.0:1776191278.331297:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3073
00000100:00100000:0.0:1776191278.331305:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a9e71f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630888448:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191278.331351:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191278.331403:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a9e71f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630888448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (267us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191278.331410:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3073
00000100:00100000:2.0:1776191278.332431:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630888448:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191279.098485:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191279.356830:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191279.356849:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630888512:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191279.356913:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191279.357391:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630888512
00000100:00100000:0.0:1776191279.357441:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3074
00000100:00100000:0.0:1776191279.357446:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029599f7c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630888512:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191279.357485:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191279.357533:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029599f7c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630888512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (621us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191279.357539:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3074
00000100:00100000:3.0:1776191279.357811:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630888512:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191280.122697:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191280.378358:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002cd3d4b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630888640:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191280.378434:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191280.378473:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1776191280.378480:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a2e3dc1e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630888576:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191280.378490:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630888640
00000100:00100000:3.0:1776191280.378502:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191280.378532:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630888576
00000100:00100000:1.0:1776191280.378551:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1551
00000100:00100000:1.0:1776191280.378558:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af44226e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630888640:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191280.378566:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1552
00000100:00100000:3.0:1776191280.378571:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009e49d076 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630888576:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191280.378587:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00002000:00000024:3.0:1776191280.378589:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191280.378628:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009e49d076 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630888576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (127us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191280.378635:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1552
00000100:00100000:3.0:1776191280.378673:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a2e3dc1e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630888576:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1776191280.379055:0:16146:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191280.379060:0:16146:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191280.379070:0:16146:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191280.379076:0:16146:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3813
00000100:00080000:2.0:1776191280.379078:0:16146:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191280.379083:0:16146:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191280.379102:0:16146:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000004f22abe6 x1862467630889024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191280.379117:0:16146:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191280.379122:0:16146:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191280.379123:0:16146:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191280.379126:0:16146:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3813
00000100:00080000:2.0:1776191280.379127:0:16146:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191280.379130:0:16146:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191280.379139:0:16146:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000001a8c7923 x1862467630889088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191280.379183:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af44226e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630888640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 625us (749us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191280.379192:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000418a6d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630888704:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191280.379193:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1551
00000100:00100000:2.0:1776191280.379231:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191280.379246:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a26e20f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630888960:0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191280.379267:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191280.379292:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c82d865 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630888896:0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191280.379312:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191280.379322:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007c94492b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630888768:0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191280.379339:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002cd3d4b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630888640:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191280.379351:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:2.0:1776191280.379358:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000161dca59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630888832:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191280.379359:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191280.379383:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003b6ef48d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630889152:0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191280.379389:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191280.379410:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630889216:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191280.379415:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191280.379506:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191280.379597:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630888896
00000100:00100000:3.0:1776191280.379732:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630888960
00000100:00100000:3.0:1776191280.379758:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630888832
00000100:00100000:3.0:1776191280.379770:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3075
00000100:00100000:3.0:1776191280.379775:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb97b35c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630888960:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191280.379814:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb97b35c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630888960:12345-0@lo:400:kworker/u8:0.0 Request processed in 38us (546us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191280.379820:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3075
00000100:00100000:3.0:1776191280.379832:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3076
00000100:00100000:3.0:1776191280.379835:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa41a1c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630888832:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191280.379862:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa41a1c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630888832:12345-0@lo:400:kworker/u8:0.0 Request processed in 26us (475us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191280.379868:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3076
00000100:00100000:3.0:1776191280.379891:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630888768
00000100:00100000:0.0:1776191280.379963:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630888704
00000100:00100000:0.0:1776191280.379989:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1702
00000100:00100000:0.0:1776191280.379993:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fc1666bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630888704:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:0.0:1776191280.380023:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fc1666bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630888704:12345-0@lo:400:kworker/u8:0.0 Request processed in 29us (793us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191280.380028:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1702
00000100:00100000:0.0:1776191280.380108:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630889152
00000100:00100000:2.0:1776191280.384799:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630889216
00000100:00100000:1.0:1776191280.385916:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4512
00000100:00100000:1.0:1776191280.385925:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002a035eb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630888896:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191280.386008:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002a035eb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630888896:12345-0@lo:400:kworker/u8:0.0 Request processed in 84us (6696us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191280.386015:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4512
00000100:00100000:3.0:1776191280.386548:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4513
00000100:00100000:3.0:1776191280.386554:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000108d0e5b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630888768:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191280.386603:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000108d0e5b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630888768:12345-0@lo:400:kworker/u8:0.0 Request processed in 49us (7248us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191280.386609:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4513
00000100:00100000:3.0:1776191280.386667:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000418a6d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630888704:0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191280.386687:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a26e20f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630888960:0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191280.386744:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000161dca59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630888832:0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191280.386754:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c82d865 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630888896:0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191280.386866:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004f22abe6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630889024:0@lo:8:kworker/u8:0.0
00000100:00100000:3.0:1776191280.386905:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191280.386928:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a8c7923 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630889088:0@lo:8:kworker/u8:0.0
00000100:00100000:3.0:1776191280.386948:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191280.386989:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630889024
00000100:00100000:3.0:1776191280.387009:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630889088
00000100:00100000:3.0:1776191280.387022:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2239
00000100:00100000:3.0:1776191280.387026:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2e3dc1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630889024:12345-0@lo:8:kworker/u8:0.0
00010000:02020000:3.0:1776191280.387132:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191280.387197:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2e3dc1e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630889024:12345-0@lo:8:kworker/u8:0.0 Request processed in 145us (267us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191280.387220:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2239
00000100:00100000:3.0:1776191280.387245:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2240
00000100:00100000:3.0:1776191280.387248:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049908ee0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630889088:12345-0@lo:8:kworker/u8:0.0
00010000:02020000:3.0:1776191280.387380:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191280.387404:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049908ee0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630889088:12345-0@lo:8:kworker/u8:0.0 Request processed in 154us (456us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191280.388297:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2240
00000100:00080000:3.0:1776191280.388357:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191280.388362:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191280.388366:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004f22abe6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630889024:0@lo:8:kworker/u8:0.0
00000100:00080000:3.0:1776191280.388376:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191280.388378:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191280.388380:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a8c7923 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630889088:0@lo:8:kworker/u8:0.0
00000100:00100000:3.0:1776191280.388470:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007c94492b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630888768:0@lo:400:kworker/u8:0.0
00000100:00100000:0.0:1776191280.404593:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4514
00000100:00100000:0.0:1776191280.404604:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003664b2f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630889152:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:0.0:1776191280.404719:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003664b2f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630889152:12345-0@lo:400:kworker/u8:0.0 Request processed in 116us (25306us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191280.404727:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4514
00000100:00100000:3.0:1776191280.404865:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003b6ef48d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630889152:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191280.406662:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4515
00000100:00100000:1.0:1776191280.406676:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d10ef768 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630889216:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191280.406847:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d10ef768 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630889216:12345-0@lo:400:kworker/u8:0.0 Request processed in 172us (27341us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191280.406909:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630889216:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191280.410963:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4515
00010000:00010000:3.0:1776191281.146408:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191282.013270:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191282.013384:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191282.013442:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191282.013478:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191282.013535:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613790464
00000100:00100000:0.0:1776191282.013588:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1968
00000100:00100000:0.0:1776191282.013595:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000160230d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613790464:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191282.013680:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000160230d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613790464:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 84us (298us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191282.013688:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1968
00000100:00100000:2.0:1776191282.013885:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613790272
00000100:00100000:2.0:1776191282.013921:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1703
00000100:00100000:2.0:1776191282.013926:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000280cef61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613790272:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191282.013975:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000280cef61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613790272:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 38us (522us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191282.013982:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1703
00000100:00100000:1.0:1776191282.020896:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613790336
00000100:00100000:2.0:1776191282.021572:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613790400
00000100:00100000:2.0:1776191282.021626:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4516
00000100:00100000:2.0:1776191282.021632:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000042dcf5f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613790336:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191282.021717:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000042dcf5f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613790336:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 84us (8959us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191282.021725:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4516
00000100:00100000:2.0:1776191282.021744:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4517
00000100:00100000:2.0:1776191282.021748:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049979283 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613790400:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191282.021773:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049979283 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613790400:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 25us (8296us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191282.021779:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4517
00000100:00100000:3.0:1776191282.022698:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191282.022778:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613790528
00000100:00100000:2.0:1776191282.022848:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2241
00000100:00100000:2.0:1776191282.022853:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002cd3d4b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613790528:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:2.0:1776191282.022968:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191282.023020:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002cd3d4b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613790528:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 166us (326us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191282.023028:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2241
00010000:00010000:3.0:1776191282.172080:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191283.195068:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191283.450593:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004a57869 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630889280:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191283.450673:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191283.450979:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630889280
00000100:00100000:1.0:1776191283.451064:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3077
00000100:00100000:1.0:1776191283.451070:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f2477cb3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630889280:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191283.451101:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191283.451153:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f2477cb3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630889280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (481us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191283.451160:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3077
00000100:00100000:3.0:1776191283.451347:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004a57869 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630889280:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191284.218722:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191284.475052:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191284.475070:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a3b02dc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630889344:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191284.475136:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191284.475286:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630889344
00000100:00100000:2.0:1776191284.475334:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3078
00000100:00100000:2.0:1776191284.475339:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000023bc758a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630889344:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191284.475385:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191284.475437:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000023bc758a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630889344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (302us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191284.475444:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3078
00000100:00100000:0.0:1776191284.475529:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a3b02dc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630889344:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191285.243444:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191285.498449:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630889408:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191285.498523:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191285.498941:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630889408
00000100:00100000:3.0:1776191285.498995:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1553
00000100:00100000:3.0:1776191285.499009:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000001330234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630889408:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191285.499055:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191285.499099:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000001330234 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630889408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (576us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191285.499105:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1553
00000100:00100000:3.0:1776191285.499148:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630889408:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1776191285.500118:0:16146:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191285.500133:0:16146:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191285.500136:0:16146:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191285.500143:0:16146:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3818
00000100:00080000:1.0:1776191285.500147:0:16146:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 6s
00000100:00080000:1.0:1776191285.500151:0:16146:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191285.500170:0:16146:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000f055ad1b x1862467630889856/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191285.500188:0:16146:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191285.500191:0:16146:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191285.500192:0:16146:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191285.500195:0:16146:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3818
00000100:00080000:1.0:1776191285.500197:0:16146:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 6s
00000100:00080000:1.0:1776191285.500202:0:16146:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191285.500217:0:16146:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000087d9e22f x1862467630889984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191285.500230:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f055ad1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630889856:0@lo:8:kworker/u8:0.0
00000100:00100000:1.0:1776191285.500265:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be5463b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630889664:0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191285.500284:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191285.500310:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087d9e22f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630889984:0@lo:8:kworker/u8:0.0
00000100:00100000:3.0:1776191285.500343:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191285.500454:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630889856
00000100:00100000:0.0:1776191285.500485:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630889984
00000100:00100000:0.0:1776191285.500513:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2242
00000100:00100000:0.0:1776191285.500520:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003b6ef48d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630889856:12345-0@lo:8:kworker/u8:0.0
00000100:00100000:3.0:1776191285.500522:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2243
00000100:00100000:3.0:1776191285.500530:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007c94492b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630889984:12345-0@lo:8:kworker/u8:0.0
00010000:02020000:0.0:1776191285.500912:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:02020000:3.0:1776191285.500944:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191285.500956:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003b6ef48d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630889856:12345-0@lo:8:kworker/u8:0.0 Request processed in 437us (673us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191285.500965:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2242
00000100:00100000:3.0:1776191285.500981:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007c94492b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630889984:12345-0@lo:8:kworker/u8:0.0 Request processed in 451us (638us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191285.500990:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2243
00000100:00100000:0.0:1776191285.500996:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040c4d502 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630889472:0@lo:400:kworker/u8:0.0
00000100:00100000:0.0:1776191285.501025:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191285.501059:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028c45c84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630889728:0@lo:400:kworker/u8:0.0
00000100:00100000:0.0:1776191285.501080:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191285.501092:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005c5ac88f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630890112:0@lo:400:kworker/u8:0.0
00000100:00100000:0.0:1776191285.501124:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191285.501145:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:0.0:1776191285.501151:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014a5e911 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630889536:0@lo:400:kworker/u8:0.0
00000100:00100000:0.0:1776191285.501175:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191285.501191:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1e9431d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630889792:0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191285.501203:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630889472
00000100:00100000:0.0:1776191285.501228:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191285.501234:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1704
00000100:00100000:3.0:1776191285.501239:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ea296a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630889472:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:0.0:1776191285.501259:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630890112
00000100:00100000:3.0:1776191285.501280:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ea296a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630889472:12345-0@lo:400:kworker/u8:0.0 Request processed in 41us (255us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191285.501287:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1704
00000100:00100000:0.0:1776191285.501298:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630889536
00000100:00100000:0.0:1776191285.501323:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4518
00000100:00100000:0.0:1776191285.501337:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003865af9a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630890112:12345-0@lo:400:kworker/u8:0.0
00000100:00080000:3.0:1776191285.501339:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191285.501343:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191285.501348:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087d9e22f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630889984:0@lo:8:kworker/u8:0.0
00000100:00080000:3.0:1776191285.501358:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191285.501361:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191285.501364:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f055ad1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630889856:0@lo:8:kworker/u8:0.0
00000100:00100000:0.0:1776191285.501378:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003865af9a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630890112:12345-0@lo:400:kworker/u8:0.0 Request processed in 49us (266us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191285.501386:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4518
00000100:00100000:3.0:1776191285.501395:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4519
00000100:00100000:3.0:1776191285.501400:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000042f08b56 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630889536:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191285.501435:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000042f08b56 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630889536:12345-0@lo:400:kworker/u8:0.0 Request processed in 34us (261us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191285.501436:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630889728
00000100:00100000:3.0:1776191285.501443:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4519
00000100:00100000:0.0:1776191285.501462:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3079
00000100:00100000:0.0:1776191285.501468:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f0579a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630889728:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191285.501478:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014a5e911 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630889536:0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191285.501488:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040c4d502 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630889472:0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191285.501501:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005c5ac88f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630890112:0@lo:400:kworker/u8:0.0
00000100:00100000:0.0:1776191285.501505:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f0579a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630889728:12345-0@lo:400:kworker/u8:0.0 Request processed in 37us (424us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191285.501513:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3079
00000100:00100000:3.0:1776191285.501525:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028c45c84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630889728:0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191285.501547:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630889792
00000100:00100000:3.0:1776191285.501579:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1969
00000100:00100000:3.0:1776191285.501583:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c0278cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630889792:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191285.501615:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c0278cc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630889792:12345-0@lo:400:kworker/u8:0.0 Request processed in 31us (388us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191285.501620:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1969
00000100:00100000:3.0:1776191285.501640:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1e9431d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630889792:0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191285.501782:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000552b8f18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630889600:0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191285.501812:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191285.501838:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630889920:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191285.501859:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191285.501896:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630889920
00000100:00100000:2.0:1776191285.501921:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1554
00000100:00100000:2.0:1776191285.501924:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000250a4bd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630889920:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191285.501941:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191285.501974:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000250a4bd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630889920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (115us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191285.501981:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1554
00000100:00100000:2.0:1776191285.502012:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630889920:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191285.502051:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630889600
00000100:00100000:2.0:1776191285.502073:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3080
00000100:00100000:2.0:1776191285.502076:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000057cf3599 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630889600:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191285.502123:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000057cf3599 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630889600:12345-0@lo:400:kworker/u8:0.0 Request processed in 45us (310us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191285.502130:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3080
00000100:00100000:3.0:1776191285.502147:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000552b8f18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630889600:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191285.505682:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191285.505735:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000628b46b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630890048:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191285.505760:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191285.506360:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630889664
00000100:00100000:3.0:1776191285.506415:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630890048
00000100:00100000:3.0:1776191285.506450:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4520
00000100:00100000:3.0:1776191285.506455:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cfe6cbc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630889664:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191285.506513:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cfe6cbc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630889664:12345-0@lo:400:kworker/u8:0.0 Request processed in 56us (840us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191285.506519:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4520
00000100:00100000:3.0:1776191285.506536:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4521
00000100:00100000:3.0:1776191285.506540:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001f8e22df pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630890048:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191285.506565:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001f8e22df pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630890048:12345-0@lo:400:kworker/u8:0.0 Request processed in 24us (805us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191285.506571:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4521
00000100:00100000:1.0:1776191285.506663:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be5463b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630889664:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191285.506675:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000628b46b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630890048:0@lo:400:kworker/u8:0.0
00010000:00010000:3.0:1776191286.267081:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191287.137256:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191287.137311:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191287.137343:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191287.137379:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613790656
00000100:00100000:1.0:1776191287.137434:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613790592
00000100:00100000:0.0:1776191287.137446:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4522
00000100:00100000:0.0:1776191287.137455:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000542b51d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613790656:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191287.137469:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1705
00000100:00100000:1.0:1776191287.137475:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e58aa936 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613790592:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191287.137530:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000542b51d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613790656:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 75us (218us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191287.137539:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4522
00000100:00100000:1.0:1776191287.146111:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e58aa936 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613790592:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 8627us (8854us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191287.146130:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1705
00000100:00100000:1.0:1776191287.146219:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613790784
00000100:00100000:1.0:1776191287.146273:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1970
00000100:00100000:1.0:1776191287.146279:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba9731d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613790784:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191287.146334:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba9731d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613790784:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 54us (8991us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191287.146341:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1970
00000100:00100000:3.0:1776191287.146968:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191287.147138:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613790720
00000100:00100000:2.0:1776191287.147183:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4523
00000100:00100000:2.0:1776191287.147188:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a8c7923 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613790720:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191287.147240:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a8c7923 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613790720:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 51us (274us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191287.147248:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4523
00000100:00100000:3.0:1776191287.159349:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191287.159457:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613790848
00000100:00100000:2.0:1776191287.159504:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2244
00000100:00100000:2.0:1776191287.159510:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f22abe6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613790848:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:2.0:1776191287.159609:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191287.159681:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f22abe6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613790848:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 170us (341us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191287.159688:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2244
00010000:00010000:3.0:1776191287.290402:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191288.320622:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191288.571146:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a3b02dc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630890176:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191288.571226:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191288.571516:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630890176
00000100:00100000:2.0:1776191288.571564:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3081
00000100:00100000:2.0:1776191288.571569:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c82d865 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630890176:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191288.571600:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191288.571656:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c82d865 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630890176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (430us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191288.571665:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3081
00000100:00100000:1.0:1776191288.571718:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a3b02dc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630890176:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191289.338284:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191289.596141:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004a57869 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630890240:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191289.596211:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191289.601055:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630890240
00000100:00100000:3.0:1776191289.601149:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3082
00000100:00100000:3.0:1776191289.601156:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f6b2ee02 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630890240:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191289.601192:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191289.601670:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004a57869 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630890240:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191289.603049:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f6b2ee02 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630890240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1873us (6820us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191289.603074:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3082
00010000:00010000:3.0:1776191290.362293:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1776191290.618350:0:16146:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191290.618357:0:16146:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191290.618360:0:16146:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191290.618368:0:16146:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3823
00000100:00080000:1.0:1776191290.618371:0:16146:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 11s
00000100:00080000:1.0:1776191290.618376:0:16146:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191290.618394:0:16146:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000edadc6bc x1862467630890752/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191290.618406:0:16146:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191290.618409:0:16146:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191290.618410:0:16146:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191290.618413:0:16146:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3823
00000100:00080000:1.0:1776191290.618414:0:16146:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 11s
00000100:00080000:1.0:1776191290.618417:0:16146:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191290.618436:0:16146:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000009d908df0 x1862467630890816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191290.618501:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023dd469f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630890432:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191290.618561:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191290.618584:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000001c99791 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630890688:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191290.618602:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191290.618618:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:1.0:1776191290.618623:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003462e3ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630890368:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191290.618644:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191290.618655:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a93cd85a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630890624:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191290.618673:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191290.618713:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630890688
00000100:00100000:1.0:1776191290.618748:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630890624
00000100:00100000:1.0:1776191290.618764:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1971
00000100:00100000:1.0:1776191290.618769:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000066f11e22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630890688:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191290.618809:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000066f11e22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630890688:12345-0@lo:400:kworker/u8:0.0 Request processed in 40us (206us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191290.618815:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1971
00000100:00100000:1.0:1776191290.618830:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1972
00000100:00100000:1.0:1776191290.618834:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a01c31a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630890624:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191290.618855:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a01c31a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630890624:12345-0@lo:400:kworker/u8:0.0 Request processed in 20us (181us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191290.618860:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1972
00000100:00100000:1.0:1776191290.618891:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a93cd85a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630890624:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191290.618900:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000001c99791 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630890688:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191290.618931:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000628b46b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630890304:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191290.618957:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191290.618990:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000edadc6bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630890752:0@lo:8:kworker/u8:0.0
00000100:00100000:0.0:1776191290.618999:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd48926d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630890496:0@lo:400:kworker/u8:0.0
00000100:00100000:0.0:1776191290.619020:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191290.619020:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191290.619054:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009d908df0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630890816:0@lo:8:kworker/u8:0.0
00000100:00100000:3.0:1776191290.619074:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191290.619448:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630890432
00000100:00100000:2.0:1776191290.619491:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3083
00000100:00100000:2.0:1776191290.619495:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d1c8a441 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630890432:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191290.619536:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d1c8a441 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630890432:12345-0@lo:400:kworker/u8:0.0 Request processed in 40us (975us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191290.619541:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3083
00000100:00100000:2.0:1776191290.619562:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630890752
00000100:00100000:2.0:1776191290.619578:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630890816
00000100:00100000:2.0:1776191290.619586:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2245
00000100:00100000:2.0:1776191290.619590:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000161dca59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630890752:12345-0@lo:8:kworker/u8:0.0
00010000:02020000:2.0:1776191290.619680:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191290.619713:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000161dca59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630890752:12345-0@lo:8:kworker/u8:0.0 Request processed in 122us (694us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191290.619719:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2245
00000100:00100000:2.0:1776191290.619728:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2246
00000100:00100000:2.0:1776191290.619731:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a26e20f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630890816:12345-0@lo:8:kworker/u8:0.0
00010000:02020000:2.0:1776191290.619813:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191290.619836:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a26e20f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630890816:12345-0@lo:8:kworker/u8:0.0 Request processed in 103us (761us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191290.619842:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2246
00000100:00100000:2.0:1776191290.619874:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023dd469f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630890432:0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191290.619960:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a3b02dc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630891072:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191290.619986:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191290.620004:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1776191290.620009:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004a57869 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630891008:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191290.620025:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191290.621265:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b1044af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630890560:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191290.621307:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191290.621324:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000253b91b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630890944:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191290.621370:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630890560
00000100:00100000:1.0:1776191290.621405:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3084
00000100:00100000:1.0:1776191290.621410:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000001c99791 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630890560:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:0.0:1776191290.621818:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008c618d84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630890880:0@lo:400:kworker/u8:0.0
00000100:00100000:0.0:1776191290.621845:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191290.621897:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000001c99791 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630890560:12345-0@lo:400:kworker/u8:0.0 Request processed in 486us (590us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191290.621905:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3084
00000100:00100000:1.0:1776191290.621975:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630891072
00000100:00100000:1.0:1776191290.621999:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630891008
00000100:00100000:1.0:1776191290.622017:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1555
00000100:00100000:1.0:1776191290.622021:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d1e8454 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630891072:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191290.622065:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191290.622097:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d1e8454 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630891072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (2111us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191290.622103:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1555
00000100:00100000:1.0:1776191290.622115:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1556
00000100:00100000:1.0:1776191290.622119:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002c9bae2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630891008:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191290.622151:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191290.622172:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002c9bae2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630891008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (2147us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191290.622178:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1556
00000100:00080000:1.0:1776191290.622245:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191290.622250:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191290.622254:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000edadc6bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630890752:0@lo:8:kworker/u8:0.0
00000100:00080000:1.0:1776191290.622264:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191290.622266:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191290.622268:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009d908df0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630890816:0@lo:8:kworker/u8:0.0
00000100:00100000:1.0:1776191290.622310:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630890304
00000100:00100000:1.0:1776191290.622340:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1706
00000100:00100000:1.0:1776191290.622344:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae4705ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630890304:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191290.622379:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae4705ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630890304:12345-0@lo:400:kworker/u8:0.0 Request processed in 35us (3422us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191290.622386:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1706
00000100:00100000:2.0:1776191290.622680:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004a57869 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630891008:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191290.622697:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a3b02dc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630891072:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191290.625703:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191290.625858:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630890368
00000100:00100000:1.0:1776191290.625860:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630890496
00000100:00100000:1.0:1776191290.625967:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630890880
00000100:00100000:1.0:1776191290.625991:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4524
00000100:00100000:1.0:1776191290.625997:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000062eedbc6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630890368:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191290.626089:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000062eedbc6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630890368:12345-0@lo:400:kworker/u8:0.0 Request processed in 91us (7444us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191290.626096:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4524
00000100:00100000:1.0:1776191290.626116:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630890944
00000100:00100000:0.0:1776191290.626134:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000628b46b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630890304:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191290.626134:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4525
00000100:00100000:1.0:1776191290.626141:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e83ca50c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630890496:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:0.0:1776191290.626153:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b1044af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630890560:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191290.626181:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e83ca50c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630890496:12345-0@lo:400:kworker/u8:0.0 Request processed in 39us (7160us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191290.626187:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4525
00000100:00100000:0.0:1776191290.626193:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4526
00000100:00100000:0.0:1776191290.626199:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d58188f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630890880:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191290.626205:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4527
00000100:00100000:1.0:1776191290.626211:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000022eb52f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630890944:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:0.0:1776191290.626250:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d58188f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630890880:12345-0@lo:400:kworker/u8:0.0 Request processed in 51us (4404us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191290.626257:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4526
00000100:00100000:0.0:1776191290.626294:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd48926d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630890496:0@lo:400:kworker/u8:0.0
00000100:00100000:0.0:1776191290.626308:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008c618d84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630890880:0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191290.626324:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003462e3ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630890368:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191290.626410:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000022eb52f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630890944:12345-0@lo:400:kworker/u8:0.0 Request processed in 199us (715us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191290.626417:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4527
00000100:00100000:0.0:1776191290.626533:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000253b91b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630890944:0@lo:400:kworker/u8:0.0
00010000:00010000:3.0:1776191291.386329:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191292.253627:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191292.253669:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191292.253713:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191292.253747:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191292.253769:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191292.253827:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613791104
00000100:00100000:0.0:1776191292.253828:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613790976
00000100:00100000:1.0:1776191292.253877:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613791168
00000100:00100000:0.0:1776191292.253879:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613791040
00000100:00100000:0.0:1776191292.253904:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4528
00000100:00100000:1.0:1776191292.253908:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1973
00000100:00100000:0.0:1776191292.253913:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048f526a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613790976:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191292.253916:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000003b7a58d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613791104:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191292.253986:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048f526a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613790976:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 73us (615us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191292.253993:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4528
00000100:00100000:0.0:1776191292.254008:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4529
00000100:00100000:2.0:1776191292.254009:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2247
00000100:00100000:0.0:1776191292.254012:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613791040:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191292.254014:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc2a58de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613791168:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:2.0:1776191292.254134:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191292.254384:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000003b7a58d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613791104:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 469us (714us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191292.254622:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1973
00000100:00100000:1.0:1776191292.254799:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613790912
00000100:00100000:1.0:1776191292.254825:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1707
00000100:00100000:1.0:1776191292.255077:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000deab4b38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613790912:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191292.255110:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000deab4b38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613790912:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 34us (1398us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191292.255125:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1707
00000100:00100000:0.0:1776191292.256284:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613791040:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 2265us (2531us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191292.256298:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4529
00000100:00100000:2.0:1776191292.256780:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc2a58de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613791168:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 2764us (3010us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191292.256789:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2247
00010000:00010000:3.0:1776191292.410644:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191293.434422:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191293.690710:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191293.690733:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007582ba84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630891136:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191293.690798:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191293.690886:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630891136
00000100:00100000:2.0:1776191293.690932:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3085
00000100:00100000:2.0:1776191293.690937:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d908df0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630891136:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191293.690985:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191293.691060:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d908df0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630891136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (261us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191293.691066:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3085
00000100:00100000:3.0:1776191293.691773:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007582ba84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630891136:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191294.458243:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191294.714445:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ca7e4d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630891200:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191294.714526:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191294.715068:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630891200
00000100:00100000:1.0:1776191294.715123:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3086
00000100:00100000:1.0:1776191294.715137:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000418a6d34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630891200:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191294.715170:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191294.715219:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000418a6d34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630891200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (692us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191294.715226:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3086
00000100:00100000:3.0:1776191294.715565:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ca7e4d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630891200:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191295.482451:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191295.739574:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630891328:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191295.739647:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191295.739685:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191295.739690:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000934a8884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630891264:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191295.739707:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191295.739784:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630891328
00000100:00100000:3.0:1776191295.739824:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630891264
00000100:00100000:3.0:1776191295.739838:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1557
00000100:00100000:3.0:1776191295.739843:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000767f2c7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630891328:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191295.739872:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191295.739907:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000767f2c7b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630891328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (261us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191295.739913:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1557
00000100:00100000:3.0:1776191295.739926:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1558
00000100:00100000:3.0:1776191295.739929:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bbd900df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630891264:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191295.739937:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191295.739952:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bbd900df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630891264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 23us (245us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191295.739957:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1558
00000100:00100000:3.0:1776191295.739987:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000934a8884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630891264:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191295.739997:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630891328:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1776191295.741785:0:16146:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1776191295.741786:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000552b8f18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630891520:0@lo:400:kworker/u8:0.0
00000100:00080000:3.0:1776191295.741791:0:16146:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191295.741793:0:16146:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191295.741797:0:16146:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3828
00000100:00080000:3.0:1776191295.741808:0:16146:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 16s
00000100:00080000:3.0:1776191295.741813:0:16146:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191295.741830:0:16146:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000040c4d502 x1862467630891712/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191295.741838:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1776191295.741842:0:16146:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191295.741845:0:16146:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191295.741846:0:16146:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191295.741848:0:16146:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3828
00000100:00080000:3.0:1776191295.741850:0:16146:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 16s
00000100:00080000:3.0:1776191295.741853:0:16146:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191295.741861:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1776191295.741861:0:16146:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000014a5e911 x1862467630891776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191295.741865:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1e9431d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630891584:0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191295.741887:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191295.741887:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1776191295.741893:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087d9e22f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630891904:0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191295.741912:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630891520
00000100:00100000:2.0:1776191295.741944:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3087
00000100:00100000:2.0:1776191295.741949:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001bc0bbec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630891520:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:0.0:1776191295.742018:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630891392:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191295.742063:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be5463b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630891456:0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191295.750221:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001bc0bbec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630891520:12345-0@lo:400:kworker/u8:0.0 Request processed in 8262us (8374us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191295.750238:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3087
00000100:00100000:2.0:1776191295.750311:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000552b8f18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630891520:0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191295.750352:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630891584
00000100:00100000:2.0:1776191295.750393:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4530
00000100:00100000:2.0:1776191295.750398:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000636d25c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630891584:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191295.750449:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000636d25c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630891584:12345-0@lo:400:kworker/u8:0.0 Request processed in 51us (8562us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191295.750455:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4530
00000100:00100000:2.0:1776191295.750480:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1e9431d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630891584:0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191295.750522:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040c4d502 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630891712:0@lo:8:kworker/u8:0.0
00000100:00100000:2.0:1776191295.750556:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191295.750572:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014a5e911 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630891776:0@lo:8:kworker/u8:0.0
00000100:00100000:2.0:1776191295.750591:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191295.750619:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630891712
00000100:00100000:2.0:1776191295.750636:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630891776
00000100:00100000:2.0:1776191295.750649:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2248
00000100:00100000:2.0:1776191295.750652:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c1848a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630891712:12345-0@lo:8:kworker/u8:0.0
00010000:02020000:2.0:1776191295.750748:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191295.750778:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c1848a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630891712:12345-0@lo:8:kworker/u8:0.0 Request processed in 125us (223us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191295.750787:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2248
00000100:00100000:2.0:1776191295.750798:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2249
00000100:00100000:2.0:1776191295.750801:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006be09a24 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630891776:12345-0@lo:8:kworker/u8:0.0
00010000:02020000:2.0:1776191295.750879:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191295.750899:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006be09a24 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630891776:12345-0@lo:8:kworker/u8:0.0 Request processed in 98us (309us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191295.750905:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2249
00000100:00080000:2.0:1776191295.750929:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191295.750933:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191295.750936:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040c4d502 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630891712:0@lo:8:kworker/u8:0.0
00000100:00080000:2.0:1776191295.750943:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191295.750945:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191295.750947:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014a5e911 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630891776:0@lo:8:kworker/u8:0.0
00000100:00100000:0.0:1776191295.751458:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191295.751493:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028c45c84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630891648:0@lo:400:kworker/u8:0.0
00000100:00100000:0.0:1776191295.751521:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191295.751877:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630891392
00000100:00100000:2.0:1776191295.751923:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1708
00000100:00100000:2.0:1776191295.751928:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a4afbcc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630891392:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191295.751969:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a4afbcc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630891392:12345-0@lo:400:kworker/u8:0.0 Request processed in 41us (514us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191295.751975:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1708
00000100:00100000:2.0:1776191295.752003:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630891648
00000100:00100000:2.0:1776191295.752025:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3088
00000100:00100000:2.0:1776191295.752028:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027e578e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630891648:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191295.753186:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027e578e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630891648:12345-0@lo:400:kworker/u8:0.0 Request processed in 1154us (1661us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191295.753197:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3088
00000100:00100000:0.0:1776191295.756130:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000940c739a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630891392:0@lo:400:kworker/u8:0.0
00000100:00100000:0.0:1776191295.756152:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028c45c84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630891648:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191295.757067:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191295.757121:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f055ad1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630891840:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191295.757151:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191295.757190:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630891456
00000100:00100000:2.0:1776191295.757246:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630891840
00000100:00100000:2.0:1776191295.757275:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4531
00000100:00100000:2.0:1776191295.757280:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000edadc6bc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630891456:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191295.757334:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000edadc6bc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630891456:12345-0@lo:400:kworker/u8:0.0 Request processed in 54us (271us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191295.757341:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4531
00000100:00100000:2.0:1776191295.757357:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4532
00000100:00100000:2.0:1776191295.757361:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a93cd85a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630891840:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191295.757383:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a93cd85a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630891840:12345-0@lo:400:kworker/u8:0.0 Request processed in 22us (233us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191295.757388:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4532
00000100:00100000:3.0:1776191295.757533:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191295.757614:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630891904
00000100:00100000:2.0:1776191295.757646:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4533
00000100:00100000:2.0:1776191295.757650:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028c45c84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630891904:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191295.757685:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028c45c84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630891904:12345-0@lo:400:kworker/u8:0.0 Request processed in 34us (153us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191295.757691:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4533
00000100:00100000:2.0:1776191295.757725:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087d9e22f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630891904:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191295.757731:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be5463b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630891456:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191295.757740:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f055ad1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630891840:0@lo:400:kworker/u8:0.0
00010000:00010000:3.0:1776191296.506355:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191297.370426:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191297.370523:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613791488
00000100:00100000:2.0:1776191297.370579:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2250
00000100:00100000:2.0:1776191297.370586:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a102519 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613791488:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:2.0:1776191297.370682:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191297.370748:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a102519 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613791488:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 161us (329us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191297.370755:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2250
00000100:00100000:3.0:1776191297.371452:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191297.371492:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191297.371512:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191297.371581:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613791232
00000100:00100000:0.0:1776191297.371618:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1709
00000100:00100000:0.0:1776191297.371637:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dbba1dca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613791232:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191297.371686:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dbba1dca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613791232:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 48us (237us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191297.371692:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1709
00000100:00100000:3.0:1776191297.372323:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191297.378785:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613791360
00000100:00100000:1.0:1776191297.378866:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613791296
00000100:00100000:1.0:1776191297.378898:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4534
00000100:00100000:1.0:1776191297.378904:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000014a5e911 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613791360:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191297.378985:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000014a5e911 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613791360:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 81us (7494us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191297.378993:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4534
00000100:00100000:1.0:1776191297.379013:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4535
00000100:00100000:1.0:1776191297.379018:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000040c4d502 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613791296:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191297.379059:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000040c4d502 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613791296:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 41us (7547us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191297.379066:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4535
00000100:00100000:0.0:1776191297.381888:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613791424
00000100:00100000:0.0:1776191297.382201:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1974
00000100:00100000:0.0:1776191297.382208:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a1e9431d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613791424:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191297.383010:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a1e9431d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613791424:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 799us (10686us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191297.383020:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1974
00010000:00010000:3.0:1776191297.530363:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191298.559183:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191298.812165:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fd82c1e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630891968:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191298.812236:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191298.812338:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630891968
00000100:00100000:2.0:1776191298.812392:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3089
00000100:00100000:2.0:1776191298.812398:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000552b8f18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630891968:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191298.812431:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191298.812496:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000552b8f18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630891968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (261us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191298.812504:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3089
00000100:00100000:1.0:1776191298.812837:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fd82c1e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630891968:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191299.418202:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191299.418256:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191299.419655:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613791616
00000100:00100000:2.0:1776191299.419717:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613791552
00000100:00100000:2.0:1776191299.419751:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1361
00000100:00100000:2.0:1776191299.419758:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f055ad1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613791616:12345-192.168.203.36@tcp:17:kworker/2:0.0
00000100:00100000:2.0:1776191299.419850:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f055ad1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613791616:12345-192.168.203.36@tcp:17:kworker/2:0.0 Request processed in 91us (1654us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191299.419858:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1361
00000100:00100000:2.0:1776191299.419878:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1362
00000100:00100000:2.0:1776191299.419882:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be5463b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613791552:12345-192.168.203.36@tcp:17:kworker/2:0.0
00000100:00100000:2.0:1776191299.419916:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be5463b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613791552:12345-192.168.203.36@tcp:17:kworker/2:0.0 Request processed in 32us (1660us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191299.419921:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1362
00010000:00010000:3.0:1776191299.578301:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191299.834331:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000301f1ca1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630892032:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191299.834403:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191299.834475:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630892032
00000100:00100000:3.0:1776191299.834527:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3090
00000100:00100000:3.0:1776191299.834533:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a3bd616 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630892032:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191299.834562:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191299.841662:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a3bd616 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630892032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7119us (7250us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191299.841680:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3090
00000100:00100000:0.0:1776191299.842973:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000301f1ca1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630892032:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191300.609093:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1776191300.860423:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191300.860431:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191300.860434:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191300.860441:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3833
00000100:00080000:2.0:1776191300.860445:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1776191300.860451:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191300.860469:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000002ae10efb x1862467630892608/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191300.860496:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191300.860499:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191300.860501:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191300.860503:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3833
00000100:00080000:2.0:1776191300.860505:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1776191300.860507:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191300.860520:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000301f1ca1 x1862467630892672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191300.860558:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002ae10efb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630892608:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191300.860622:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191300.860647:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000301f1ca1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630892672:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191300.860669:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191300.860706:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630892608
00000100:00100000:2.0:1776191300.860734:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630892672
00000100:00100000:2.0:1776191300.860750:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2251
00000100:00100000:2.0:1776191300.860756:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001ca7e4d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630892608:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191300.860855:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191300.860894:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001ca7e4d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630892608:12345-0@lo:8:kworker/u8:2.0 Request processed in 137us (272us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191300.860904:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2251
00000100:00100000:2.0:1776191300.860920:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2252
00000100:00100000:2.0:1776191300.860923:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000098bb370f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630892672:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191300.861020:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191300.861079:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000098bb370f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630892672:12345-0@lo:8:kworker/u8:2.0 Request processed in 155us (409us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191300.861085:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2252
00000100:00080000:2.0:1776191300.861217:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191300.861221:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191300.861224:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002ae10efb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630892608:0@lo:8:kworker/u8:2.0
00000100:00080000:2.0:1776191300.861232:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191300.861235:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191300.861237:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000301f1ca1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630892672:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191300.863373:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000c128c04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630892288:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191300.863435:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191300.863463:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cec144c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630892544:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191300.863496:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191300.863519:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [1->0]
00000100:00100000:0.0:1776191300.863525:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087d9e22f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630892096:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191300.863547:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191300.863560:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000070c80d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630892352:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191300.863581:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191300.863594:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fd82c1e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630892736:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191300.863611:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191300.863641:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630892544
00000100:00100000:0.0:1776191300.863681:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1975
00000100:00100000:0.0:1776191300.863687:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000887bf0ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630892544:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191300.863733:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000887bf0ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630892544:12345-0@lo:400:kworker/u8:2.0 Request processed in 46us (249us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191300.863741:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1975
00000100:00100000:0.0:1776191300.863766:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630892352
00000100:00100000:0.0:1776191300.863787:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630892736
00000100:00100000:0.0:1776191300.863804:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4536
00000100:00100000:0.0:1776191300.863808:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000449a0225 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630892352:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191300.863837:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000449a0225 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630892352:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (256us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191300.863843:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4536
00000100:00100000:0.0:1776191300.863854:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4537
00000100:00100000:0.0:1776191300.863858:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005820d21e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630892736:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191300.863881:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005820d21e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630892736:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (269us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191300.863886:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4537
00000100:00100000:0.0:1776191300.863919:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000070c80d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630892352:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191300.863927:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fd82c1e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630892736:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191300.863934:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cec144c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630892544:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191300.864105:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000d20c9eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630892224:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191300.864133:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191300.864157:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dcfa8951 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630892480:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191300.864176:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191300.864186:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000226faff2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630892864:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191300.864202:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191300.864219:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [2->3]
00000100:00100000:1.0:1776191300.864224:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000911fdeb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630892160:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191300.864249:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191300.864262:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a2eb5de3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630892416:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191300.864280:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191300.864292:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000934a8884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630892800:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191300.864308:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191300.864335:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630892096
00000100:00100000:1.0:1776191300.864358:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630892864
00000100:00100000:1.0:1776191300.864373:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1559
00000100:00100000:1.0:1776191300.864377:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba296d84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630892096:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191300.864398:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191300.864429:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba296d84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630892096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (882us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191300.864435:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1559
00000100:00100000:1.0:1776191300.864447:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1560
00000100:00100000:1.0:1776191300.864450:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005112615a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630892864:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191300.864459:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191300.864483:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005112615a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630892864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 32us (281us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191300.864502:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1560
00000100:00100000:1.0:1776191300.864524:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630892160
00000100:00100000:1.0:1776191300.864546:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1710
00000100:00100000:1.0:1776191300.864549:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b9375c8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630892160:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191300.864576:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b9375c8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630892160:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (327us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191300.864583:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1710
00000100:00100000:1.0:1776191300.864608:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630892288
00000100:00100000:1.0:1776191300.864624:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630892416
00000100:00100000:1.0:1776191300.864634:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3091
00000100:00100000:1.0:1776191300.864637:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002fc9e52b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630892288:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191300.864662:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002fc9e52b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630892288:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (1228us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191300.864667:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3091
00000100:00100000:1.0:1776191300.864677:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3092
00000100:00100000:1.0:1776191300.864680:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000365abfb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630892416:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191300.864701:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000365abfb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630892416:12345-0@lo:400:kworker/u8:2.0 Request processed in 20us (421us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191300.864706:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3092
00000100:00100000:1.0:1776191300.864727:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630892224
00000100:00100000:1.0:1776191300.864745:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630892800
00000100:00100000:1.0:1776191300.864760:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4538
00000100:00100000:1.0:1776191300.864764:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000abaaa3da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630892224:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191300.864788:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000abaaa3da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630892224:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (655us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191300.864793:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4538
00000100:00100000:1.0:1776191300.864803:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4539
00000100:00100000:1.0:1776191300.864806:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de9cc0f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630892800:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191300.864828:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de9cc0f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630892800:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (520us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191300.864832:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4539
00000100:00100000:1.0:1776191300.864865:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000911fdeb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630892160:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191300.864875:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a2eb5de3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630892416:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191300.864883:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000934a8884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630892800:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191300.864892:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000d20c9eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630892224:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191300.864905:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000226faff2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630892864:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191300.864943:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087d9e22f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630892096:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191300.864952:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000c128c04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630892288:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191300.865467:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630892480
00000100:00100000:0.0:1776191300.865576:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1976
00000100:00100000:0.0:1776191300.865581:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000078deb88d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630892480:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191300.865626:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000078deb88d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630892480:12345-0@lo:400:kworker/u8:2.0 Request processed in 44us (1450us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191300.865633:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1976
00000100:00100000:1.0:1776191300.866325:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dcfa8951 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630892480:0@lo:400:kworker/u8:2.0
00010000:00010000:3.0:1776191301.628693:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191302.496648:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191302.496696:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191302.496735:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191302.496757:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191302.496847:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613791744
00000100:00100000:0.0:1776191302.496902:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613791808
00000100:00100000:0.0:1776191302.496921:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4540
00000100:00100000:0.0:1776191302.496927:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000087d9e22f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613791744:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191302.497012:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000087d9e22f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613791744:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 84us (371us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191302.497019:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4540
00000100:00100000:0.0:1776191302.497148:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4541
00000100:00100000:0.0:1776191302.497152:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba5b492f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613791808:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191302.497178:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba5b492f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613791808:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 25us (422us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191302.497187:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4541
00000100:00100000:1.0:1776191302.497550:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613791680
00000100:00100000:1.0:1776191302.497587:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1711
00000100:00100000:1.0:1776191302.497592:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fec76140 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613791680:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191302.497620:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fec76140 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613791680:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 27us (885us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191302.497626:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1711
00000100:00100000:2.0:1776191302.498155:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613791936
00000100:00100000:2.0:1776191302.498194:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2253
00000100:00100000:2.0:1776191302.498198:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003bea0498 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613791936:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:2.0:1776191302.498294:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191302.498325:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003bea0498 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613791936:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 126us (1630us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191302.498332:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2253
00000100:00100000:3.0:1776191302.506547:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191302.511979:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613791872
00000100:00100000:1.0:1776191302.512104:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1977
00000100:00100000:1.0:1776191302.512111:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b93c82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613791872:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191302.512181:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b93c82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613791872:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 70us (5642us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191302.512189:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1977
00010000:00010000:3.0:1776191302.650404:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191303.674243:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191303.932514:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191303.932535:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000301f1ca1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630892928:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191303.932599:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191303.932714:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630892928
00000100:00100000:2.0:1776191303.932761:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3093
00000100:00100000:2.0:1776191303.932766:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba29c9bf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630892928:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191303.932796:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191303.932845:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba29c9bf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630892928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (247us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191303.932852:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3093
00000100:00100000:3.0:1776191303.933001:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000301f1ca1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630892928:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191304.698337:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191304.954391:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191304.954407:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002ae10efb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630892992:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191304.954472:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191304.954880:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630892992
00000100:00100000:3.0:1776191304.954977:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3094
00000100:00100000:3.0:1776191304.954983:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000066f11e22 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630892992:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191304.955013:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191304.955083:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000066f11e22 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630892992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (612us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191304.955090:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3094
00000100:00100000:1.0:1776191304.955154:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002ae10efb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630892992:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191305.732396:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1776191305.978238:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191305.978246:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191305.978249:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191305.978257:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3838
00000100:00080000:2.0:1776191305.978261:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1776191305.978267:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191305.978287:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000000c128c04 x1862467630893504/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191305.978305:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191305.978308:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191305.978309:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191305.978312:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3838
00000100:00080000:2.0:1776191305.978314:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1776191305.978316:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191305.978326:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000000d20c9eb x1862467630893568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191305.978379:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000c128c04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630893504:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191305.978440:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191305.978468:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000d20c9eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630893568:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191305.978488:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191305.978526:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630893504
00000100:00100000:2.0:1776191305.978555:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630893568
00000100:00100000:2.0:1776191305.978570:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2254
00000100:00100000:2.0:1776191305.978576:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000911fdeb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630893504:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191305.978674:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191305.978712:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000911fdeb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630893504:12345-0@lo:8:kworker/u8:2.0 Request processed in 135us (271us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191305.978719:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2254
00000100:00100000:2.0:1776191305.978735:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2255
00000100:00100000:2.0:1776191305.978738:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cec144c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630893568:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191305.978825:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191305.978846:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cec144c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630893568:12345-0@lo:8:kworker/u8:2.0 Request processed in 107us (359us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191305.978852:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2255
00000100:00080000:2.0:1776191305.978901:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191305.978905:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191305.978908:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000c128c04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630893504:0@lo:8:kworker/u8:2.0
00000100:00080000:2.0:1776191305.978916:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191305.978918:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191305.978920:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000d20c9eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630893568:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191305.979249:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c1848a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630893056:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191305.979286:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191305.979301:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002ae10efb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630893312:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191305.979324:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191305.979354:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a2eb5de3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630893696:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191305.979381:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191305.979399:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:3.0:1776191305.979405:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006be09a24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630893120:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191305.979423:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191305.979435:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000301f1ca1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630893376:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191305.979456:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191305.979480:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007582ba84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630893248:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191305.979501:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191305.979514:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000934a8884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630893632:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191305.979531:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191305.979543:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:3.0:1776191305.979548:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001ca7e4d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630893184:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191305.979566:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191305.979581:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dcfa8951 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630893440:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191305.979599:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191305.979622:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630893312
00000100:00100000:3.0:1776191305.979647:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630893184
00000100:00100000:3.0:1776191305.979661:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3095
00000100:00100000:3.0:1776191305.979664:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007bb93380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630893312:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191305.979708:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007bb93380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630893312:12345-0@lo:400:kworker/u8:2.0 Request processed in 42us (383us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191305.979713:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3095
00000100:00100000:3.0:1776191305.979725:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3096
00000100:00100000:3.0:1776191305.979728:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000034f2f5bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630893184:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191305.979754:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000034f2f5bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630893184:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (188us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191305.979760:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3096
00000100:00100000:3.0:1776191305.979776:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630893696
00000100:00100000:3.0:1776191305.979799:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630893120
00000100:00100000:3.0:1776191305.979813:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630893248
00000100:00100000:3.0:1776191305.979826:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630893632
00000100:00100000:3.0:1776191305.979837:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4542
00000100:00100000:3.0:1776191305.979840:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a1e9431d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630893696:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191305.979865:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a1e9431d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630893696:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (484us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191305.979870:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4542
00000100:00100000:3.0:1776191305.979879:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4543
00000100:00100000:3.0:1776191305.979883:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ac42fbca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630893120:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191305.979919:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ac42fbca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630893120:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (495us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191305.979924:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4543
00000100:00100000:3.0:1776191305.979934:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4544
00000100:00100000:3.0:1776191305.979936:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001425031c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630893248:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191305.979957:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001425031c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630893248:12345-0@lo:400:kworker/u8:2.0 Request processed in 20us (457us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191305.979963:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4544
00000100:00100000:3.0:1776191305.979972:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4545
00000100:00100000:3.0:1776191305.979975:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c5625d66 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630893632:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191305.979997:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c5625d66 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630893632:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (466us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191305.980002:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4545
00000100:00100000:1.0:1776191305.980287:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630893440
00000100:00100000:1.0:1776191305.980314:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1978
00000100:00100000:1.0:1776191305.980318:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad4a7212 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630893440:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191305.980364:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad4a7212 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630893440:12345-0@lo:400:kworker/u8:2.0 Request processed in 44us (764us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191305.980369:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1978
00000100:00100000:1.0:1776191305.980424:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006be09a24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630893120:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191305.980435:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002ae10efb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630893312:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191305.980442:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a2eb5de3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630893696:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191305.980481:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001ca7e4d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630893184:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191305.980489:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dcfa8951 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630893440:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191305.980496:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007582ba84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630893248:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191305.980503:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000934a8884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630893632:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191305.980561:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a01c31a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630893760:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191305.980587:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191305.980618:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630893760
00000100:00100000:1.0:1776191305.980643:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1561
00000100:00100000:1.0:1776191305.980647:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a102519 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630893760:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191305.980667:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191305.980698:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a102519 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630893760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (110us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191305.980706:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1561
00000100:00100000:1.0:1776191305.980734:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a01c31a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630893760:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191305.980911:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630893376
00000100:00100000:3.0:1776191305.980941:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1979
00000100:00100000:3.0:1776191305.980945:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006de4f7b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630893376:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191305.980988:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006de4f7b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630893376:12345-0@lo:400:kworker/u8:2.0 Request processed in 41us (1531us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191305.980993:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1979
00000100:00100000:0.0:1776191305.981078:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630893056
00000100:00100000:0.0:1776191305.981111:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1712
00000100:00100000:0.0:1776191305.981115:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cdaa8581 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630893056:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191305.981147:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cdaa8581 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630893056:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (1861us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191305.981153:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1712
00000100:00100000:0.0:1776191305.981207:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c1893c50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630893824:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191305.981230:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191305.981254:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630893824
00000100:00100000:0.0:1776191305.981274:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1562
00000100:00100000:0.0:1776191305.981277:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000589db251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630893824:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191305.981287:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191305.981314:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000589db251 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630893824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (84us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191305.981320:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1562
00000100:00100000:0.0:1776191305.981570:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c1893c50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630893824:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191305.981773:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000301f1ca1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630893376:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191305.981784:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c1848a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630893056:0@lo:400:kworker/u8:2.0
00010000:00010000:3.0:1776191306.746240:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191307.610614:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191307.610667:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191307.610698:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191307.610743:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613792256
00000100:00100000:3.0:1776191307.610765:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613792192
00000100:00100000:1.0:1776191307.610797:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1980
00000100:00100000:3.0:1776191307.610807:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2256
00000100:00100000:1.0:1776191307.610808:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000d20c9eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613792192:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191307.610817:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c1848a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613792256:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00000100:00100000:1.0:1776191307.610892:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000d20c9eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613792192:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 85us (192us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191307.610900:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1980
00000100:00100000:0.0:1776191307.610913:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613792064
00010000:02020000:3.0:1776191307.610926:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191307.610956:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4546
00000100:00100000:3.0:1776191307.610960:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c1848a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613792256:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 145us (352us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191307.610966:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000301f1ca1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613792064:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191307.610980:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2256
00000100:00100000:0.0:1776191307.611006:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000301f1ca1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613792064:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 42us (337us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191307.611385:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191307.611416:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191307.611435:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613792128
00000100:00100000:2.0:1776191307.611492:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613792000
00000100:00100000:2.0:1776191307.611524:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1713
00000100:00100000:2.0:1776191307.611528:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009803db2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613792000:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191307.611562:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009803db2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613792000:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 33us (179us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191307.611568:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1713
00000100:00100000:0.0:1776191307.613463:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4546
00000100:00100000:3.0:1776191307.615211:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4547
00000100:00100000:3.0:1776191307.615223:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2a7dce2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613792128:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191307.615329:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2a7dce2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613792128:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 108us (3913us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191307.615337:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4547
00010000:00010000:3.0:1776191307.774339:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191308.797452:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191309.050749:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776191309.050767:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000c128c04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630893888:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191309.050851:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191309.051015:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630893888
00000100:00100000:2.0:1776191309.051087:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3097
00000100:00100000:2.0:1776191309.051093:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c1893c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630893888:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191309.051127:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191309.051179:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c1893c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630893888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (328us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191309.051186:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3097
00000100:00100000:0.0:1776191309.051262:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000c128c04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630893888:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191309.818240:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191310.075170:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fd82c1e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630893952:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191310.075238:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191310.075306:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630893952
00000100:00100000:0.0:1776191310.075361:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3098
00000100:00100000:0.0:1776191310.075368:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a01c31a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630893952:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191310.075399:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191310.075447:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a01c31a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630893952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (210us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191310.075455:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3098
00000100:00100000:1.0:1776191310.075726:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fd82c1e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630893952:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191310.842830:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191311.098406:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dab16da3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630894016:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191311.098500:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191311.098509:0:16146:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191311.098515:0:16146:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191311.098518:0:16146:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191311.098524:0:16146:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3844
00000100:00080000:1.0:1776191311.098527:0:16146:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1776191311.098534:0:16146:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191311.098541:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd48926d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630894272:0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191311.098558:0:16146:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000005ca51694 x1862467630894592/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191311.098573:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191311.098578:0:16146:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191311.098582:0:16146:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191311.098584:0:16146:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191311.098588:0:16146:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3844
00000100:00080000:1.0:1776191311.098590:0:16146:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1776191311.098591:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005c5ac88f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630894528:0@lo:400:kworker/u8:0.0
00000100:00080000:1.0:1776191311.098596:0:16146:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191311.098612:0:16146:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000069413549 x1862467630894656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191311.098622:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191311.098638:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:2.0:1776191311.098643:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008c618d84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630894208:0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191311.098666:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191311.098695:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023dd469f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630894464:0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191311.098727:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191311.098759:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630894528
00000100:00100000:2.0:1776191311.098813:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630894464
00000100:00100000:2.0:1776191311.098833:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1981
00000100:00100000:2.0:1776191311.098839:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000c128c04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630894528:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191311.098901:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000c128c04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630894528:12345-0@lo:400:kworker/u8:0.0 Request processed in 62us (281us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191311.098908:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1981
00000100:00100000:2.0:1776191311.098926:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1982
00000100:00100000:2.0:1776191311.098929:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007582ba84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630894464:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191311.098955:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007582ba84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630894464:12345-0@lo:400:kworker/u8:0.0 Request processed in 25us (228us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191311.098961:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1982
00000100:00100000:2.0:1776191311.098977:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630894272
00000100:00100000:3.0:1776191311.098998:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630894016
00000100:00100000:2.0:1776191311.099006:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3099
00000100:00100000:2.0:1776191311.099010:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd82c1e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630894272:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191311.099070:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1563
00000100:00100000:3.0:1776191311.099076:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070c80d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630894016:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191311.099082:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd82c1e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630894272:12345-0@lo:400:kworker/u8:0.0 Request processed in 69us (509us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191311.099088:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3099
00002000:00000024:3.0:1776191311.099116:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191311.099126:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023dd469f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630894464:0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191311.099141:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd48926d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630894272:0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191311.099156:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005c5ac88f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630894528:0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191311.099160:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070c80d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630894016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (663us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191311.099167:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1563
00000100:00100000:2.0:1776191311.099174:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dab16da3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630894016:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191311.099194:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003462e3ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630894144:0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191311.099228:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191311.099239:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ca51694 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630894592:0@lo:8:kworker/u8:0.0
00000100:00100000:3.0:1776191311.099249:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000628b46b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630894400:0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191311.099270:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191311.099282:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191311.099291:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000069413549 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630894656:0@lo:8:kworker/u8:0.0
00000100:00100000:3.0:1776191311.099305:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:3.0:1776191311.099313:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000253b91b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630894080:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191311.099319:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191311.099351:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630894592
00000100:00100000:2.0:1776191311.099367:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630894656
00000100:00100000:2.0:1776191311.099378:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2257
00000100:00100000:2.0:1776191311.099381:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dcfa8951 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630894592:12345-0@lo:8:kworker/u8:0.0
00010000:02020000:2.0:1776191311.099473:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191311.099505:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dcfa8951 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630894592:12345-0@lo:8:kworker/u8:0.0 Request processed in 122us (237us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191311.099511:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2257
00000100:00100000:2.0:1776191311.099522:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2258
00000100:00100000:2.0:1776191311.099525:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001ca7e4d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630894656:12345-0@lo:8:kworker/u8:0.0
00010000:02020000:2.0:1776191311.099608:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191311.099632:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001ca7e4d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630894656:12345-0@lo:8:kworker/u8:0.0 Request processed in 106us (315us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191311.099637:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2258
00000100:00080000:2.0:1776191311.099663:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191311.099666:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191311.099669:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ca51694 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630894592:0@lo:8:kworker/u8:0.0
00000100:00080000:2.0:1776191311.099676:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191311.099678:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191311.099680:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000069413549 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630894656:0@lo:8:kworker/u8:0.0
00000100:00100000:2.0:1776191311.099715:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630894400
00000100:00100000:2.0:1776191311.099736:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3100
00000100:00100000:2.0:1776191311.099740:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ce2fb2ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630894400:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191311.099772:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ce2fb2ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630894400:12345-0@lo:400:kworker/u8:0.0 Request processed in 31us (493us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191311.099793:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3100
00000100:00100000:2.0:1776191311.099831:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630894208
00000100:00100000:2.0:1776191311.099855:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4548
00000100:00100000:2.0:1776191311.099859:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000934a8884 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630894208:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191311.099894:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000934a8884 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630894208:12345-0@lo:400:kworker/u8:0.0 Request processed in 33us (1227us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191311.099900:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4548
00000100:00100000:2.0:1776191311.099925:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008c618d84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630894208:0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191311.100493:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191311.100523:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b1044af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630894336:0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191311.100552:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191311.100576:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000628b46b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630894400:0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191311.100592:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b5928219 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630894784:0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191311.100611:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191311.100625:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191311.100630:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ed42626 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630894720:0@lo:400:kworker/u8:0.0
00000100:00100000:3.0:1776191311.100648:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191311.101060:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630894080
00000100:00100000:1.0:1776191311.101095:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1564
00000100:00100000:1.0:1776191311.101100:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000cbdfd62 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630894080:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191311.101118:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191311.101154:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000cbdfd62 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630894080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (662us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191311.101161:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1564
00000100:00100000:3.0:1776191311.101459:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000253b91b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630894080:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191311.101738:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630894336
00000100:00100000:1.0:1776191311.101762:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630894784
00000100:00100000:1.0:1776191311.101773:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630894720
00000100:00100000:1.0:1776191311.101802:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4549
00000100:00100000:1.0:1776191311.101807:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ed5180d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630894336:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191311.101858:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ed5180d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630894336:12345-0@lo:400:kworker/u8:0.0 Request processed in 50us (1305us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191311.101864:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4549
00000100:00100000:1.0:1776191311.101876:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4550
00000100:00100000:1.0:1776191311.101879:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000086c77a9e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630894784:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191311.101902:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000086c77a9e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630894784:12345-0@lo:400:kworker/u8:0.0 Request processed in 22us (1291us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191311.101908:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4550
00000100:00100000:1.0:1776191311.101919:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4551
00000100:00100000:1.0:1776191311.101922:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c345c5b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630894720:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:1.0:1776191311.101944:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c345c5b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630894720:12345-0@lo:400:kworker/u8:0.0 Request processed in 21us (1296us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191311.101948:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4551
00000100:00100000:2.0:1776191311.102413:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ed42626 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630894720:0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191311.102427:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b5928219 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630894784:0@lo:400:kworker/u8:0.0
00000100:00100000:2.0:1776191311.102439:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b1044af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630894336:0@lo:400:kworker/u8:0.0
00000100:00100000:0.0:1776191311.102687:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630894144
00000100:00100000:0.0:1776191311.102795:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1714
00000100:00100000:0.0:1776191311.102800:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000364ff3a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630894144:12345-0@lo:400:kworker/u8:0.0
00000100:00100000:0.0:1776191311.105475:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000364ff3a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630894144:12345-0@lo:400:kworker/u8:0.0 Request processed in 2666us (6239us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191311.105491:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1714
00000100:00100000:3.0:1776191311.111140:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003462e3ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630894144:0@lo:400:kworker/u8:0.0
00010000:00010000:3.0:1776191311.866653:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191312.733360:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191312.733415:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191312.733439:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613792576
00000100:00100000:3.0:1776191312.733458:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191312.733484:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613792320
00000100:00100000:3.0:1776191312.733488:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191312.733499:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2259
00000100:00100000:2.0:1776191312.733507:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a5d3af6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613792576:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00000100:00100000:0.0:1776191312.733520:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1715
00000100:00100000:3.0:1776191312.733526:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191312.733529:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ea43294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613792320:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191312.733571:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613792512
00000100:00100000:3.0:1776191312.733600:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1983
00000100:00100000:3.0:1776191312.733604:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008cc5f0ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613792512:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00010000:02020000:2.0:1776191312.733617:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191312.733652:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ea43294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613792320:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 125us (238us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191312.733661:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1715
00000100:00100000:1.0:1776191312.733701:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613792448
00000100:00100000:0.0:1776191312.733713:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613792384
00000100:00100000:0.0:1776191312.733754:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4552
00000100:00100000:0.0:1776191312.733760:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a34feed9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613792384:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191312.733765:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4553
00000100:00100000:1.0:1776191312.733773:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a70c215b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613792448:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191312.735809:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008cc5f0ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613792512:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 2194us (2278us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191312.735818:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a5d3af6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613792576:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 2297us (2451us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191312.735826:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1983
00000100:00100000:2.0:1776191312.735835:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2259
00000100:00100000:0.0:1776191312.736470:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a34feed9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613792384:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 2708us (2982us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191312.736480:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4552
00000100:00100000:1.0:1776191312.737781:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a70c215b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613792448:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 4002us (4318us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191312.737796:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4553
00010000:00010000:3.0:1776191312.891016:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191313.914921:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191314.172339:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191314.174800:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a2eb5de3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630894848:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191314.174877:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191314.175078:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630894848
00000100:00100000:2.0:1776191314.175132:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3101
00000100:00100000:2.0:1776191314.175137:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af172616 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630894848:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191314.175171:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191314.175235:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af172616 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630894848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (358us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191314.175242:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3101
00000100:00100000:1.0:1776191314.175332:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a2eb5de3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630894848:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191314.938299:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191315.194785:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1776191315.194800:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002ae10efb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630894912:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191315.194869:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191315.194950:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630894912
00000100:00100000:0.0:1776191315.194996:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3102
00000100:00100000:0.0:1776191315.195001:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000074fc7059 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630894912:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191315.195056:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191315.195108:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000074fc7059 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630894912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (240us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191315.195114:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3102
00000100:00100000:3.0:1776191315.195224:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002ae10efb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630894912:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191315.963130:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191316.218286:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b81e3ace pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630895104:0@lo:400:kworker/u8:2.0
00000100:00080000:1.0:1776191316.218366:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191316.218371:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191316.218375:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191316.218381:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3849
00000100:00080000:1.0:1776191316.218384:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1776191316.218390:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191316.218410:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000005d27964 x1862467630895424/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191316.218415:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bac7d72b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630894976:0@lo:400:kworker/u8:2.0
00000100:00080000:1.0:1776191316.218435:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191316.218439:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191316.218441:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191316.218445:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3849
00000100:00080000:1.0:1776191316.218447:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1776191316.218450:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191316.218463:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191316.218466:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000054825189 x1862467630895488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191316.218491:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004fd8278 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630895232:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191316.218511:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000019e5e056 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630895168:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191316.218548:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191316.218566:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000090ee1844 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630895552:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191316.218588:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191316.218603:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000005d27964 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630895424:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191316.218609:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776191316.218617:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7c3b55d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630895360:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191316.218633:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191316.218662:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630895168
00000100:00100000:2.0:1776191316.218662:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000054825189 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630895488:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191316.218698:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191316.218721:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630895552
00000100:00100000:1.0:1776191316.218741:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4554
00000100:00100000:1.0:1776191316.218746:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5228cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630895168:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191316.218749:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630895424
00000100:00100000:2.0:1776191316.218771:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2260
00000100:00100000:2.0:1776191316.218775:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ae10efb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630895424:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191316.218794:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5228cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630895168:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (246us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191316.218802:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4554
00000100:00100000:1.0:1776191316.218819:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4555
00000100:00100000:1.0:1776191316.218823:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ca787ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630895552:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191316.218847:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ca787ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630895552:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (261us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191316.218852:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4555
00010000:02020000:2.0:1776191316.218864:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191316.218871:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191316.218903:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ae10efb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630895424:12345-0@lo:8:kworker/u8:2.0 Request processed in 126us (270us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191316.218906:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000019e5e056 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630895168:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191316.218913:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2260
00000100:00100000:1.0:1776191316.218921:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000090ee1844 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630895552:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191316.218928:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630895488
00000100:00100000:2.0:1776191316.218944:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630895360
00000100:00100000:2.0:1776191316.218966:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1984
00000100:00100000:2.0:1776191316.218971:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e56aacf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630895360:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191316.218976:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630894976
00000100:00100000:1.0:1776191316.219008:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1716
00000100:00100000:1.0:1776191316.219015:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d186bef1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630894976:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191316.219021:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e56aacf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630895360:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (139us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191316.219074:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d186bef1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630894976:12345-0@lo:400:kworker/u8:2.0 Request processed in 59us (612us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191316.219081:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1716
00000100:00100000:3.0:1776191316.219200:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bf73ce67 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630895040:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191316.219227:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191316.219245:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c7c28c8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630895296:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191316.219249:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191316.220486:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1984
00000100:00100000:0.0:1776191316.220738:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630895104
00000100:00100000:0.0:1776191316.220785:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3103
00000100:00100000:0.0:1776191316.220791:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dab16da3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630895104:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191316.220849:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dab16da3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630895104:12345-0@lo:400:kworker/u8:2.0 Request processed in 58us (2493us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191316.220856:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3103
00000100:00100000:0.0:1776191316.220889:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b81e3ace pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630895104:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191316.221876:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2261
00000100:00100000:1.0:1776191316.221884:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2eb5de3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630895488:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:1.0:1776191316.221985:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191316.222052:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2eb5de3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630895488:12345-0@lo:8:kworker/u8:2.0 Request processed in 167us (3355us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191316.222058:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2261
00000100:00100000:1.0:1776191316.222165:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630895040
00000100:00100000:1.0:1776191316.222197:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4556
00000100:00100000:1.0:1776191316.222200:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b5b887d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630895040:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191316.222235:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b5b887d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630895040:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (3008us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191316.222241:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4556
00000100:00100000:1.0:1776191316.223446:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000090ee1844 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630895744:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191316.223503:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191316.223555:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630895744
00000100:00100000:1.0:1776191316.223588:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1565
00000100:00100000:1.0:1776191316.223593:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019e5e056 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630895744:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191316.223619:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191316.223655:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019e5e056 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630895744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (153us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191316.223674:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1565
00000100:00100000:1.0:1776191316.223716:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000090ee1844 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630895744:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191316.223760:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7c3b55d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630895360:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191316.223788:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191316.223809:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f7f1f93 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630895616:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191316.223832:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191316.223852:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bac7d72b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630894976:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191316.223873:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630895232
00000100:00100000:1.0:1776191316.223898:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3104
00000100:00100000:1.0:1776191316.223903:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f7c3b55d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630895232:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191316.223939:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f7c3b55d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630895232:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (150us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191316.223947:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3104
00000100:00100000:1.0:1776191316.223969:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630895616
00000100:00080000:2.0:1776191316.223971:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191316.223977:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191316.223982:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000005d27964 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630895424:0@lo:8:kworker/u8:2.0
00000100:00080000:2.0:1776191316.223994:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1776191316.223995:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4557
00000100:00080000:2.0:1776191316.223997:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191316.224002:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090ee1844 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630895616:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191316.224003:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000054825189 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630895488:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191316.224055:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090ee1844 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630895616:12345-0@lo:400:kworker/u8:2.0 Request processed in 53us (222us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191316.224061:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4557
00000100:00100000:1.0:1776191316.224090:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f7f1f93 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630895616:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191316.224100:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004fd8278 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630895232:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191316.224204:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191316.224229:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006be09a24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630895680:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191316.224252:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191316.224285:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bf73ce67 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630895040:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191316.225030:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630895296
00000100:00100000:2.0:1776191316.225189:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1985
00000100:00100000:2.0:1776191316.225194:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096b9f269 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630895296:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191316.225253:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096b9f269 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630895296:12345-0@lo:400:kworker/u8:2.0 Request processed in 58us (1050us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191316.225260:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1985
00000100:00100000:1.0:1776191316.225381:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630895680
00000100:00100000:1.0:1776191316.225420:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1566
00000100:00100000:1.0:1776191316.225427:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000cc4c333 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630895680:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191316.225447:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191316.225478:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000cc4c333 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630895680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (1226us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191316.225483:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1566
00000100:00100000:3.0:1776191316.225719:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c7c28c8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630895296:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191316.225736:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006be09a24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630895680:0@lo:13:osp-pre-0-0.0
00010000:00010000:3.0:1776191316.986513:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191317.855776:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191317.855827:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191317.855867:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191317.855962:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613792640
00000100:00100000:0.0:1776191317.856016:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1717
00000100:00100000:0.0:1776191317.856024:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000050bd026a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613792640:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191317.856134:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000050bd026a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613792640:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 109us (366us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191317.856142:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1717
00000100:00100000:2.0:1776191317.856783:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613792704
00000100:00100000:2.0:1776191317.856824:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4558
00000100:00100000:2.0:1776191317.856829:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa749ef5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613792704:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191317.856879:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa749ef5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613792704:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 48us (1052us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191317.856886:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4558
00000100:00100000:2.0:1776191317.856909:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613792832
00000100:00100000:2.0:1776191317.856931:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1986
00000100:00100000:2.0:1776191317.856936:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009501226 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613792832:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191317.856962:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009501226 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613792832:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 25us (1095us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191317.856968:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1986
00000100:00100000:3.0:1776191317.868130:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191317.868179:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191317.868405:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613792896
00000100:00100000:1.0:1776191317.868452:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2262
00000100:00100000:1.0:1776191317.868459:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f5850781 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613792896:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:1.0:1776191317.868568:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191317.868652:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f5850781 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613792896:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 192us (473us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191317.868660:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2262
00000100:00100000:0.0:1776191317.868885:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613792768
00000100:00100000:0.0:1776191317.868932:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4559
00000100:00100000:0.0:1776191317.868937:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c92d37da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613792768:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191317.868977:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c92d37da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613792768:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 39us (856us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191317.868983:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4559
00010000:00010000:3.0:1776191318.012681:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191319.034406:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191319.290530:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006be09a24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630895808:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191319.290611:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191319.290814:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630895808
00000100:00100000:0.0:1776191319.290902:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3105
00000100:00100000:0.0:1776191319.290908:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004fd8278 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630895808:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191319.290942:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191319.290994:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004fd8278 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630895808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (396us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191319.291001:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3105
00000100:00100000:2.0:1776191319.291072:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006be09a24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630895808:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191320.062489:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191320.314308:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191320.315062:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006be09a24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630895872:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191320.315126:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191320.320365:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630895872
00000100:00100000:0.0:1776191320.320435:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3106
00000100:00100000:0.0:1776191320.320442:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000417ffd59 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630895872:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191320.320484:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191320.320568:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000417ffd59 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630895872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (5442us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191320.320584:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3106
00000100:00100000:3.0:1776191320.320732:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006be09a24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630895872:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191321.082794:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191321.338293:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000226faff2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630896000:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191321.338324:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006be09a24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630895936:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191321.338389:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191321.338420:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003239335f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630896192:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191321.338448:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191321.338467:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191321.338473:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191321.338475:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000051b5d53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630896128:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191321.338505:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191321.338529:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000088d289e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630896064:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191321.338565:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191321.338960:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000039d6e1cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630896256:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191321.338989:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191321.339027:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630895936
00000100:00100000:1.0:1776191321.339094:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630896000
00000100:00100000:1.0:1776191321.339111:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1567
00000100:00100000:1.0:1776191321.339117:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003462e3ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630895936:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191321.339145:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191321.339186:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003462e3ec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630895936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (798us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191321.339193:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1567
00000100:00100000:1.0:1776191321.339208:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1568
00000100:00100000:1.0:1776191321.339211:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f7f1f93 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630896000:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191321.339220:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191321.339246:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f7f1f93 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630896000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (775us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191321.339263:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1568
00000100:00100000:1.0:1776191321.339281:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630896128
00000100:00100000:1.0:1776191321.339302:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630896256
00000100:00100000:1.0:1776191321.340006:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4560
00000100:00100000:1.0:1776191321.340011:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000253b91b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630896128:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191321.340161:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000253b91b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630896128:12345-0@lo:400:kworker/u8:4.0 Request processed in 149us (1656us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191321.340169:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4560
00000100:00100000:1.0:1776191321.340184:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4561
00000100:00100000:1.0:1776191321.340187:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bac7d72b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630896256:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191321.340214:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bac7d72b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630896256:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (1226us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191321.340219:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4561
00000100:00100000:1.0:1776191321.340956:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000051b5d53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630896128:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191321.340986:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006be09a24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630895936:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191321.341028:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000039d6e1cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630896256:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191321.341079:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000226faff2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630896000:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191321.341134:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630896192
00000100:00100000:1.0:1776191321.341174:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3107
00000100:00100000:1.0:1776191321.341178:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b1044af pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630896192:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191321.341230:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b1044af pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630896192:12345-0@lo:400:kworker/u8:4.0 Request processed in 51us (2781us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191321.341236:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3107
00000100:00100000:1.0:1776191321.341277:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003239335f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630896192:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191321.341722:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630896064
00000100:00080000:3.0:1776191321.344249:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191321.344256:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191321.344259:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191321.344266:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3854
00000100:00080000:3.0:1776191321.344269:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1776191321.344275:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191321.344295:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000a868d0c4 x1862467630896384/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191321.344310:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191321.344313:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191321.344315:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191321.344318:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3854
00000100:00080000:3.0:1776191321.344319:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1776191321.344322:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191321.344332:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000118d0482 x1862467630896448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191321.344387:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000090a9e988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630896512:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191321.344445:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191321.344476:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191321.344480:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003239335f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630896576:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191321.344500:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191321.344533:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630896512
00000100:00100000:3.0:1776191321.344737:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630896576
00000100:00100000:3.0:1776191321.344757:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4562
00000100:00100000:3.0:1776191321.344762:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000039d6e1cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630896512:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191321.344806:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000039d6e1cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630896512:12345-0@lo:400:kworker/u8:4.0 Request processed in 43us (361us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191321.344812:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4562
00000100:00100000:3.0:1776191321.344837:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4563
00000100:00100000:3.0:1776191321.344841:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000051b5d53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630896576:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191321.344866:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000051b5d53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630896576:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (366us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191321.344871:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4563
00000100:00100000:3.0:1776191321.344907:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003239335f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630896576:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191321.344916:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000090a9e988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630896512:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191321.344940:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1776191321.344946:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004e5b784 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630896320:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191321.344981:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191321.345013:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630896320
00000100:00100000:3.0:1776191321.345297:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3108
00000100:00100000:3.0:1776191321.345301:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090a9e988 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630896320:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191321.345335:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090a9e988 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630896320:12345-0@lo:400:kworker/u8:4.0 Request processed in 33us (354us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191321.345340:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3108
00000100:00100000:3.0:1776191321.345366:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004e5b784 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630896320:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191321.345399:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a868d0c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630896384:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191321.345423:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191321.345443:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000118d0482 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630896448:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191321.345459:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191321.345489:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630896384
00000100:00100000:3.0:1776191321.345506:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630896448
00000100:00100000:3.0:1776191321.345517:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2263
00000100:00100000:3.0:1776191321.345520:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004e5b784 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630896384:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191321.345801:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191321.345843:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004e5b784 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630896384:12345-0@lo:8:kworker/u8:4.0 Request processed in 321us (419us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191321.345849:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2263
00000100:00100000:3.0:1776191321.345861:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2264
00000100:00100000:3.0:1776191321.345864:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003239335f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630896448:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191321.345951:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1776191321.346193:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191321.346198:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191321.346202:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a868d0c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630896384:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191321.346250:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003239335f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630896448:12345-0@lo:8:kworker/u8:4.0 Request processed in 384us (790us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191321.346256:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2264
00000100:00100000:2.0:1776191321.346292:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1718
00000100:00100000:2.0:1776191321.346303:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008cbd400d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630896064:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191321.346345:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008cbd400d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630896064:12345-0@lo:400:kworker/u8:4.0 Request processed in 47us (7791us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191321.346349:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1718
00000100:00100000:3.0:1776191321.351373:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000088d289e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630896064:0@lo:400:kworker/u8:4.0
00000100:00080000:1.0:1776191321.351572:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191321.351577:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191321.351581:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000118d0482 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630896448:0@lo:8:kworker/u8:4.0
00010000:00010000:3.0:1776191322.106444:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191322.973786:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191322.973828:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191322.973863:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191322.973886:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191322.973911:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191322.973943:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613793152
00000100:00100000:3.0:1776191322.974000:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613793216
00000100:00100000:3.0:1776191322.974019:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1987
00000100:00100000:3.0:1776191322.974026:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000118d0482 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613793152:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191322.974121:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000118d0482 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613793152:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 94us (257us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191322.974128:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1987
00000100:00100000:3.0:1776191322.974145:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2265
00000100:00100000:3.0:1776191322.974149:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ff26b50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613793216:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:3.0:1776191322.974263:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191322.974304:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ff26b50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613793216:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 154us (393us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191322.974311:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2265
00000100:00100000:3.0:1776191322.974331:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613793024
00000100:00100000:3.0:1776191322.974356:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613793088
00000100:00100000:3.0:1776191322.974373:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4564
00000100:00100000:3.0:1776191322.974377:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000088d289e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613793024:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191322.974405:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000088d289e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613793024:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 27us (577us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191322.974411:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4564
00000100:00100000:3.0:1776191322.974422:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4565
00000100:00100000:3.0:1776191322.974426:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a868d0c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613793088:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191322.974448:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a868d0c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613793088:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 22us (562us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191322.974455:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4565
00000100:00100000:2.0:1776191322.974846:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613792960
00000100:00100000:2.0:1776191322.974875:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1719
00000100:00100000:2.0:1776191322.974880:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000afc79a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613792960:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191322.974921:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000afc79a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613792960:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 41us (1144us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191322.974927:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1719
00010000:00010000:3.0:1776191323.130663:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191324.154350:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191324.410233:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1776191324.410256:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000628b46b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630896640:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191324.410322:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191324.410816:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630896640
00000100:00100000:1.0:1776191324.410918:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3109
00000100:00100000:1.0:1776191324.410924:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eefb5d99 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630896640:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191324.410959:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191324.411023:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eefb5d99 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630896640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (701us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191324.411031:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3109
00000100:00100000:2.0:1776191324.411141:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000628b46b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630896640:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191325.181154:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191325.434569:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191325.434585:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000628b46b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630896704:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191325.434665:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191325.435794:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630896704
00000100:00100000:1.0:1776191325.435881:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3110
00000100:00100000:1.0:1776191325.435887:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c0278cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630896704:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191325.435924:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191325.435995:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c0278cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630896704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (1331us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191325.436003:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3110
00000100:00100000:0.0:1776191325.436087:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000628b46b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630896704:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191326.202408:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191326.458902:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a81e70bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630896768:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191326.459079:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191326.459187:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191326.459198:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008c618d84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630896832:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191326.459214:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000003b7a58d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630896896:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191326.459236:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191326.459244:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191326.459249:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191326.459252:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191326.459258:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3859
00000100:00080000:1.0:1776191326.459261:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1776191326.459265:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d5dde41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630896960:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191326.459273:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c7c28c8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630897024:0@lo:400:kworker/u8:4.0
00000100:00080000:1.0:1776191326.459282:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191326.459293:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191326.459302:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000b5928219 x1862467630897344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191326.459311:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000005d27964 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630897216:0@lo:400:kworker/u8:4.0
00000100:00080000:1.0:1776191326.459316:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191326.459318:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191326.459320:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191326.459322:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3859
00000100:00080000:1.0:1776191326.459324:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1776191326.459327:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191326.459331:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191326.459335:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000006ed42626 x1862467630897408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191326.459346:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191326.459350:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000054825189 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630897152:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191326.459364:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b5928219 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630897344:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191326.459387:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191326.459387:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191326.459399:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776191326.459401:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ed42626 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630897408:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191326.459404:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ca51694 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630897536:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191326.459419:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191326.459423:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191326.459465:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630896832
00000100:00100000:1.0:1776191326.459465:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630897216
00000100:00100000:1.0:1776191326.459499:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630897344
00000100:00100000:0.0:1776191326.459501:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1569
00000100:00100000:0.0:1776191326.459507:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb519ed0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630896832:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191326.459513:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630897408
00000100:00100000:1.0:1776191326.459525:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1988
00000100:00100000:1.0:1776191326.459528:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000226faff2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630897216:12345-0@lo:400:kworker/u8:4.0
00002000:00000024:0.0:1776191326.459535:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191326.459563:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb519ed0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630896832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (328us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191326.459563:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000226faff2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630897216:12345-0@lo:400:kworker/u8:4.0 Request processed in 35us (232us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191326.459571:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1569
00000100:00100000:1.0:1776191326.459571:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1988
00000100:00100000:1.0:1776191326.459583:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2266
00000100:00100000:1.0:1776191326.459586:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006be09a24 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630897344:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191326.459590:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630896960
00000100:00100000:0.0:1776191326.459608:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630897536
00000100:00100000:0.0:1776191326.459622:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4566
00000100:00100000:0.0:1776191326.459626:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc2a58de pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630896960:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191326.459651:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc2a58de pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630896960:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (358us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191326.459657:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4566
00000100:00100000:0.0:1776191326.459666:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4567
00000100:00100000:0.0:1776191326.459669:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000005f434a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630897536:12345-0@lo:400:kworker/u8:4.0
00010000:02020000:1.0:1776191326.459681:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191326.459687:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000005f434a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630897536:12345-0@lo:400:kworker/u8:4.0 Request processed in 18us (264us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191326.459692:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4567
00000100:00100000:1.0:1776191326.459708:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006be09a24 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630897344:12345-0@lo:8:kworker/u8:4.0 Request processed in 120us (321us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191326.459713:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630897152
00000100:00100000:1.0:1776191326.459714:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2266
00000100:00100000:1.0:1776191326.459723:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2267
00000100:00100000:1.0:1776191326.459726:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a63ab978 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630897408:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191326.459731:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3111
00000100:00100000:0.0:1776191326.459735:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ec42a12f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630897152:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191326.459758:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ec42a12f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630897152:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (372us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191326.459764:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3111
00000100:00100000:0.0:1776191326.459781:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191326.459802:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630896896
00010000:02020000:1.0:1776191326.459810:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191326.459818:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1570
00000100:00100000:0.0:1776191326.459821:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003b6ef48d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630896896:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191326.459830:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191326.459830:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a63ab978 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630897408:12345-0@lo:8:kworker/u8:4.0 Request processed in 104us (412us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191326.459836:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2267
00000100:00100000:0.0:1776191326.459852:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003b6ef48d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630896896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 30us (71us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191326.459857:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1570
00000100:00080000:1.0:1776191326.459877:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191326.459880:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191326.459881:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000003b7a58d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630896896:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191326.459883:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b5928219 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630897344:0@lo:8:kworker/u8:4.0
00000100:00080000:1.0:1776191326.459890:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191326.459892:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191326.459894:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ed42626 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630897408:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191326.459904:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ca51694 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630897536:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191326.459911:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000054825189 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630897152:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191326.459919:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d5dde41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630896960:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191326.459926:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000005d27964 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630897216:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191326.459926:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bf73ce67 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630897088:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191326.459949:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191326.459956:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630896768
00000100:00100000:1.0:1776191326.459961:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000069413549 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630897472:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191326.459978:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1720
00000100:00100000:1.0:1776191326.459979:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191326.459982:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003026b1b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630896768:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191326.460008:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003026b1b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630896768:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (931us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191326.460014:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1720
00000100:00100000:0.0:1776191326.460062:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630897472
00000100:00100000:0.0:1776191326.460083:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4568
00000100:00100000:0.0:1776191326.460086:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad386bcf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630897472:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191326.460118:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad386bcf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630897472:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (138us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191326.460123:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4568
00000100:00100000:0.0:1776191326.460151:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000069413549 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630897472:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191326.460580:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630897088
00000100:00100000:1.0:1776191326.460609:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4569
00000100:00100000:1.0:1776191326.460614:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d4e3b26a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630897088:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191326.460619:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191326.460651:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b81e3ace pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630897280:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191326.460663:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d4e3b26a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630897088:12345-0@lo:400:kworker/u8:4.0 Request processed in 47us (713us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191326.460670:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4569
00000100:00100000:3.0:1776191326.460684:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191326.460701:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bf73ce67 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630897088:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191326.460720:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008c618d84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630896832:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191326.460733:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a81e70bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630896768:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191326.460739:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630897024
00000100:00100000:1.0:1776191326.460766:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3112
00000100:00100000:1.0:1776191326.460770:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d0e4254d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630897024:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191326.460781:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630897280
00000100:00100000:1.0:1776191326.460814:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d0e4254d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630897024:12345-0@lo:400:kworker/u8:4.0 Request processed in 42us (1372us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191326.460820:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3112
00000100:00100000:3.0:1776191326.461064:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1989
00000100:00100000:3.0:1776191326.461069:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048ee9cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630897280:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191326.461103:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048ee9cec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630897280:12345-0@lo:400:kworker/u8:4.0 Request processed in 33us (421us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191326.461772:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1989
00000100:00100000:2.0:1776191326.461813:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c7c28c8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630897024:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191326.461827:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b81e3ace pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630897280:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191327.226252:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191328.093389:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191328.093508:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191328.093551:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191328.093653:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613793472
00000100:00100000:2.0:1776191328.093712:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1990
00000100:00100000:2.0:1776191328.093719:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bed67ee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613793472:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191328.093787:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bed67ee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613793472:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 67us (237us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191328.093795:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1990
00000100:00100000:1.0:1776191328.095746:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613793344
00000100:00100000:1.0:1776191328.095808:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4570
00000100:00100000:1.0:1776191328.095814:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b08e6b10 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613793344:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191328.095896:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b08e6b10 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613793344:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 82us (2389us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191328.095903:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4570
00000100:00100000:0.0:1776191328.098631:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613793280
00000100:00100000:0.0:1776191328.098773:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1721
00000100:00100000:0.0:1776191328.098780:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be2451ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613793280:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191328.098877:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be2451ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613793280:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 96us (5496us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191328.098893:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1721
00000100:00100000:2.0:1776191328.107194:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191328.107391:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191328.107483:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613793408
00000100:00100000:1.0:1776191328.107538:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4571
00000100:00100000:1.0:1776191328.107545:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bd48926d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613793408:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191328.107618:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bd48926d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613793408:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 72us (228us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191328.107626:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4571
00000100:00100000:3.0:1776191328.110254:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613793536
00000100:00100000:3.0:1776191328.110307:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2268
00000100:00100000:3.0:1776191328.110314:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c5ac88f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613793536:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:3.0:1776191328.110670:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191328.111098:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c5ac88f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613793536:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 782us (3910us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191328.111109:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2268
00010000:00010000:3.0:1776191328.251548:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191329.274600:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191329.532679:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023dd469f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630897600:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191329.532748:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191329.532987:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630897600
00000100:00100000:2.0:1776191329.533075:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3113
00000100:00100000:2.0:1776191329.533080:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e72cee95 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630897600:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191329.533113:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191329.533156:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e72cee95 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630897600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (408us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191329.533163:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3113
00000100:00100000:3.0:1776191329.533700:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023dd469f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630897600:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191330.298313:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191330.555129:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191330.555149:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023dd469f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630897664:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191330.555226:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191330.555426:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630897664
00000100:00100000:1.0:1776191330.555478:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3114
00000100:00100000:1.0:1776191330.555484:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007c94492b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630897664:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191330.555517:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191330.555609:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007c94492b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630897664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (383us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191330.555615:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3114
00000100:00100000:0.0:1776191330.556666:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023dd469f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630897664:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191331.322277:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191331.578256:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004f22abe6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630897728:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191331.578377:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191331.578477:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630897728
00000100:00100000:0.0:1776191331.578520:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1571
00000100:00100000:0.0:1776191331.578526:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ec90674 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630897728:12345-0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1776191331.578554:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00002000:00000024:0.0:1776191331.578558:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00080000:3.0:1776191331.578560:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1776191331.578594:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004250bccf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630897792:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191331.578600:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ec90674 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630897728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (222us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191331.578607:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1571
00000100:00100000:2.0:1776191331.578635:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191331.578643:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009af94ad9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630897984:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191331.578657:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bf4604b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630898048:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191331.578672:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191331.578693:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191331.578712:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004f22abe6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630897728:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191331.578721:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00080000:3.0:1776191331.578723:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1776191331.578729:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e9827495 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630897856:0@lo:400:kworker/u8:2.0
00000100:00080000:3.0:1776191331.578729:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3864
00000100:00100000:0.0:1776191331.578730:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00080000:3.0:1776191331.578732:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1776191331.578737:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191331.578739:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000021a52169 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630897920:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191331.578758:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000000a10d073 x1862467630898240/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191331.578759:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1776191331.578778:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1776191331.578779:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191331.578780:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b2a1967f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630898112:0@lo:400:kworker/u8:2.0
00000100:00080000:3.0:1776191331.578783:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191331.578785:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191331.578788:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3864
00000100:00080000:3.0:1776191331.578790:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1776191331.578794:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191331.578805:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008a2b80b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630898176:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191331.578806:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000032a96b7 x1862467630898304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191331.578808:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191331.578840:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630897984
00000100:00100000:0.0:1776191331.578851:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191331.578853:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c7bea5f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630898432:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191331.578868:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630898112
00000100:00100000:0.0:1776191331.578881:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d9f622e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630898368:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191331.578885:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3115
00000100:00100000:3.0:1776191331.578887:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191331.578890:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000161dca59 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630897984:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191331.578927:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000161dca59 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630897984:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (255us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191331.578933:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3116
00000100:00100000:0.0:1776191331.578938:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191331.578940:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000023dd469f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630898112:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191331.578975:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000a10d073 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630898240:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191331.578981:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000023dd469f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630898112:12345-0@lo:400:kworker/u8:2.0 Request processed in 41us (173us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191331.581082:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009af94ad9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630897984:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191331.581107:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3115
00000100:00100000:0.0:1776191331.581138:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630898048
00000100:00100000:2.0:1776191331.581152:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630897920
00000100:00100000:0.0:1776191331.581181:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630898432
00000100:00100000:2.0:1776191331.581290:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630898368
00000100:00100000:0.0:1776191331.581297:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4572
00000100:00100000:0.0:1776191331.581304:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000628b46b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630898048:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191331.581313:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4573
00000100:00100000:2.0:1776191331.581318:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f22abe6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630897920:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191331.581374:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000628b46b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630898048:12345-0@lo:400:kworker/u8:2.0 Request processed in 70us (2682us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191331.581381:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4572
00000100:00100000:0.0:1776191331.581392:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4574
00000100:00100000:0.0:1776191331.581395:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f97d550a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630898432:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191331.581417:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f97d550a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630898432:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (2533us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191331.581422:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4574
00000100:00100000:0.0:1776191331.581430:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4575
00000100:00100000:0.0:1776191331.581433:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000940c739a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630898368:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191331.581456:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000940c739a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630898368:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (2521us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191331.581461:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4575
00000100:00100000:0.0:1776191331.581483:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630897792
00000100:00100000:0.0:1776191331.581502:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1572
00000100:00100000:0.0:1776191331.581505:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008c618d84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630897792:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191331.581521:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191331.581589:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f22abe6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630897920:12345-0@lo:400:kworker/u8:2.0 Request processed in 269us (2811us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191331.581597:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4573
00000100:00100000:2.0:1776191331.581625:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630897856
00000100:00100000:0.0:1776191331.581655:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008c618d84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630897792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (3021us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191331.581657:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1722
00000100:00100000:2.0:1776191331.581664:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f9c8ab18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630897856:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191331.581668:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1572
00000100:00100000:2.0:1776191331.581699:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f9c8ab18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630897856:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (2940us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191331.581705:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1722
00000100:00100000:2.0:1776191331.581769:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c7bea5f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630898432:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191331.581772:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630898176
00000100:00100000:2.0:1776191331.581781:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e9827495 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630897856:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191331.581796:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b2a1967f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630898112:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191331.581811:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004250bccf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630897792:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191331.581822:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bf4604b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630898048:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191331.581876:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1991
00000100:00100000:0.0:1776191331.581882:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a26e20f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630898176:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191331.581898:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d9f622e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630898368:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191331.581912:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000021a52169 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630897920:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191331.581926:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a26e20f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630898176:12345-0@lo:400:kworker/u8:2.0 Request processed in 42us (3075us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191331.581928:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008a2b80b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630898176:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191331.581939:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1991
00000100:00100000:1.0:1776191331.582411:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191331.582434:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000032a96b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630898304:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191331.582466:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191331.582690:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630898240
00000100:00100000:0.0:1776191331.582751:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630898304
00000100:00100000:1.0:1776191331.582787:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2269
00000100:00100000:1.0:1776191331.582793:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e2ce3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630898240:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191331.582796:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2270
00000100:00100000:2.0:1776191331.582804:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8a67d69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630898304:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:1.0:1776191331.583395:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191331.583446:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e2ce3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630898240:12345-0@lo:8:kworker/u8:2.0 Request processed in 652us (1036us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191331.583454:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2269
00000100:00080000:1.0:1776191331.583505:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191331.583509:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191331.583513:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000a10d073 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630898240:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191331.583603:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3116
00010000:02020000:2.0:1776191331.584071:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191331.584175:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8a67d69 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630898304:12345-0@lo:8:kworker/u8:2.0 Request processed in 1369us (1708us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191331.584182:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2270
00000100:00080000:1.0:1776191331.584949:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191331.584956:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191331.584961:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000032a96b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630898304:0@lo:8:kworker/u8:2.0
00010000:00010000:0.0:1776191332.347619:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191333.212277:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191333.212336:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191333.212462:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613793664
00000100:00100000:1.0:1776191333.212529:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4576
00000100:00100000:1.0:1776191333.212535:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2988da5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613793664:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191333.212665:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2988da5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613793664:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 129us (329us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191333.212673:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4576
00000100:00100000:3.0:1776191333.213350:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613793600
00000100:00100000:3.0:1776191333.213389:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1723
00000100:00100000:3.0:1776191333.213394:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081b9520e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613793600:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191333.213427:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081b9520e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613793600:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 32us (1156us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191333.213433:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1723
00000100:00100000:0.0:1776191333.217091:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191333.217373:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191333.217471:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191333.217901:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613793792
00000100:00100000:0.0:1776191333.217954:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613793856
00000100:00100000:0.0:1776191333.217976:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1992
00000100:00100000:0.0:1776191333.217983:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000014441fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613793792:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191333.218068:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000014441fbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613793792:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 84us (696us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191333.218075:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1992
00000100:00100000:0.0:1776191333.218105:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2271
00000100:00100000:0.0:1776191333.218109:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e600ea8b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613793856:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:0.0:1776191333.218201:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191333.218227:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e600ea8b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613793856:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 117us (757us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191333.218233:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2271
00000100:00100000:2.0:1776191333.218638:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613793728
00000100:00100000:2.0:1776191333.218684:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4577
00000100:00100000:2.0:1776191333.218690:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000003b7a58d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613793728:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191333.218731:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000003b7a58d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613793728:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 41us (1650us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191333.218742:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4577
00010000:00010000:3.0:1776191333.373657:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191334.394396:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191334.653599:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000455a3f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630898496:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191334.653670:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191334.657241:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630898496
00000100:00100000:0.0:1776191334.657320:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3117
00000100:00100000:0.0:1776191334.657326:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000055f4b7ff pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630898496:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191334.657390:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191334.657527:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000055f4b7ff pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630898496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 200us (3858us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191334.657534:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3117
00000100:00100000:3.0:1776191334.657699:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000455a3f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630898496:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191335.418374:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191335.675962:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000455a3f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630898560:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191335.676065:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191335.679899:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630898560
00000100:00100000:1.0:1776191335.679975:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3118
00000100:00100000:1.0:1776191335.679982:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000155ae841 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630898560:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191335.680079:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191335.680164:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000155ae841 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630898560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 181us (4133us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191335.680171:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3118
00000100:00100000:2.0:1776191335.680384:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000455a3f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630898560:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191336.442710:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191336.698313:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191336.698331:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006605fbf0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630898688:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191336.698331:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc36af09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630898624:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1776191336.698495:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191336.698500:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191336.698503:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191336.698507:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3869
00000100:00080000:1.0:1776191336.698509:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1776191336.698514:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191336.698533:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000cf2c1df6 x1862467630899200/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191336.698547:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191336.698550:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191336.698551:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191336.698554:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3869
00000100:00080000:1.0:1776191336.698556:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1776191336.698559:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191336.698568:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000007756d7ae x1862467630899264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191336.698597:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf2c1df6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630899200:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191336.698988:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd153a77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630898944:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191336.700328:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191336.700344:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ede69d54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630898816:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191336.700382:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f74cc947 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630898880:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191336.700414:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191336.700534:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191336.700557:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dfe84e20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630899328:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191336.700569:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000640b7818 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630899136:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191336.700581:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191336.700610:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e486c123 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630899072:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191336.700616:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191336.700617:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191336.700651:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191336.700655:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [3->2]
00000100:00100000:3.0:1776191336.700664:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000da5c05bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630898752:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191336.700676:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630899136
00000100:00100000:3.0:1776191336.700698:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191336.700710:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630898880
00000100:00100000:3.0:1776191336.700720:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006644a6e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630899008:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191336.700723:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630899072
00000100:00100000:0.0:1776191336.700749:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3119
00000100:00100000:3.0:1776191336.700753:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191336.700757:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1993
00000100:00100000:0.0:1776191336.700761:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb1d57ef pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630898880:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191336.700767:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003f01d2f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630899136:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191336.700773:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e555734e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630899392:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191336.700797:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191336.700831:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003f01d2f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630899136:12345-0@lo:400:kworker/u8:2.0 Request processed in 59us (214us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191336.700832:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb1d57ef pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630898880:12345-0@lo:400:kworker/u8:2.0 Request processed in 73us (416us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191336.700845:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1993
00000100:00100000:0.0:1776191336.700846:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3119
00000100:00100000:0.0:1776191336.700866:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630899008
00000100:00100000:2.0:1776191336.700869:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1994
00000100:00100000:2.0:1776191336.700875:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000061ace3cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630899072:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191336.700998:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000061ace3cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630899072:12345-0@lo:400:kworker/u8:2.0 Request processed in 122us (348us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191336.701004:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1994
00000100:00100000:2.0:1776191336.701194:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630898752
00000100:00100000:2.0:1776191336.701233:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1724
00000100:00100000:2.0:1776191336.701237:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b0b64a4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630898752:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191336.701267:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b0b64a4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630898752:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (572us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191336.701273:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1724
00000100:00100000:0.0:1776191336.701719:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3120
00000100:00100000:0.0:1776191336.701729:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a2b80b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630899008:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191336.701765:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a2b80b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630899008:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (1019us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191336.701771:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3120
00000100:00100000:2.0:1776191336.701839:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630898944
00000100:00100000:2.0:1776191336.701868:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630898816
00000100:00100000:3.0:1776191336.701882:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000da5c05bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630898752:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191336.701897:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006644a6e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630899008:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191336.701932:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630898624
00000100:00100000:3.0:1776191336.701959:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1573
00000100:00100000:3.0:1776191336.701972:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000455a3f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630898624:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191336.701995:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191336.702051:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000455a3f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630898624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (1729us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191336.702058:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1573
00000100:00100000:3.0:1776191336.702085:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630899328
00000100:00100000:3.0:1776191336.702106:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630899392
00000100:00100000:3.0:1776191336.702118:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4578
00000100:00100000:3.0:1776191336.702122:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000032a96b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630898944:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191336.702158:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000032a96b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630898944:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (1625us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191336.702164:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4578
00000100:00100000:3.0:1776191336.702176:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4579
00000100:00100000:3.0:1776191336.702181:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006dd31ddc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630898816:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191336.702206:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006dd31ddc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630898816:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (1627us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191336.702210:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4579
00000100:00100000:3.0:1776191336.702220:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4580
00000100:00100000:3.0:1776191336.702235:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000a10d073 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630899328:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191336.702265:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000a10d073 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630899328:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (1654us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191336.702271:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4580
00000100:00100000:3.0:1776191336.702282:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4581
00000100:00100000:3.0:1776191336.702286:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000021a52169 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630899392:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191336.702293:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191336.702322:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007756d7ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630899264:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191336.702337:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000021a52169 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630899392:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (1528us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191336.702344:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4581
00000100:00100000:1.0:1776191336.702358:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191336.702372:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ede69d54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630898816:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191336.702378:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630899200
00000100:00100000:2.0:1776191336.702389:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e486c123 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630899072:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191336.702401:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630899264
00000100:00100000:3.0:1776191336.702418:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2272
00000100:00100000:3.0:1776191336.702421:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028951562 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630899200:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191336.702513:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191336.702545:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191336.702609:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f74cc947 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630898880:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191336.702620:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000640b7818 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630899136:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191336.702635:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc36af09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630898624:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191336.702679:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e555734e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630899392:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191336.702689:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd153a77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630898944:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191336.702697:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dfe84e20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630899328:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191336.702812:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2273
00000100:00100000:2.0:1776191336.702816:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000020640bc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630899264:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191336.704184:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630898688
00000100:00100000:0.0:1776191336.704237:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1574
00000100:00100000:0.0:1776191336.704243:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f62c71af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630898688:12345-0@lo:13:osp-pre-0-0.0
00010000:02020000:2.0:1776191336.704312:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191336.704353:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000020640bc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630899264:12345-0@lo:8:kworker/u8:2.0 Request processed in 1536us (1997us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191336.704362:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2273
00002000:00000024:0.0:1776191336.704489:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191336.704534:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f62c71af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630898688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 290us (1990us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191336.704541:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1574
00000100:00100000:2.0:1776191336.704615:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006605fbf0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630898688:0@lo:13:osp-pre-0-0.0
00000100:00080000:1.0:1776191336.704653:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191336.704659:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191336.704663:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007756d7ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630899264:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191336.704714:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028951562 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630899200:12345-0@lo:8:kworker/u8:2.0 Request processed in 2290us (2422us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191336.704722:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2272
00000100:00080000:1.0:1776191336.704752:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191336.704756:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191336.704760:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf2c1df6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630899200:0@lo:8:kworker/u8:2.0
00010000:00010000:3.0:1776191337.466496:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191338.333957:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191338.334095:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191338.334131:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191338.334202:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613793984
00000100:00100000:2.0:1776191338.334275:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4582
00000100:00100000:2.0:1776191338.334283:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048ee9cec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613793984:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191338.334363:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048ee9cec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613793984:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 80us (268us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191338.334371:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4582
00000100:00100000:1.0:1776191338.335065:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613794176
00000100:00100000:3.0:1776191338.335099:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191338.335139:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191338.335148:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613794112
00000100:00100000:3.0:1776191338.335176:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613794048
00000100:00100000:0.0:1776191338.335201:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1995
00000100:00100000:0.0:1776191338.335209:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bed67ee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613794112:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191338.335217:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4583
00000100:00100000:3.0:1776191338.335223:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000014441fbb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613794048:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191338.335261:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bed67ee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613794112:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 50us (1127us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191338.335262:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000014441fbb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613794048:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 36us (121us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191338.335281:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1995
00000100:00100000:3.0:1776191338.335282:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4583
00000100:00100000:0.0:1776191338.335308:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2274
00000100:00100000:0.0:1776191338.335313:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ff26b50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613794176:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00000100:00100000:3.0:1776191338.335331:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613793920
00000100:00100000:3.0:1776191338.335356:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1725
00000100:00100000:3.0:1776191338.335361:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085b2d193 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613793920:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191338.335386:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085b2d193 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613793920:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 25us (289us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191338.335392:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1725
00010000:02020000:0.0:1776191338.335408:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191338.335518:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ff26b50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613794176:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 204us (1568us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191338.335527:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2274
00010000:00010000:3.0:1776191338.490852:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191339.517055:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191339.770310:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191339.770327:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000036dae86d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630899456:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191339.770391:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191339.770477:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630899456
00000100:00100000:0.0:1776191339.770522:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3121
00000100:00100000:0.0:1776191339.770526:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e600ea8b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630899456:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191339.770556:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191339.770600:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e600ea8b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630899456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (208us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191339.770606:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3121
00000100:00100000:2.0:1776191339.770711:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000036dae86d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630899456:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191340.538868:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191340.795080:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191340.795118:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000036dae86d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630899520:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191340.795193:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191340.795294:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630899520
00000100:00100000:2.0:1776191340.795344:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3122
00000100:00100000:2.0:1776191340.795350:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cf2c1df6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630899520:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191340.795381:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191340.795449:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cf2c1df6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630899520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (256us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191340.795456:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3122
00000100:00100000:2.0:1776191340.795497:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000036dae86d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630899520:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191341.563556:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1776191341.818517:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1776191341.818519:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c2466414 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630899712:0@lo:400:kworker/u8:2.0
00000100:00080000:0.0:1776191341.818526:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191341.818531:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191341.818537:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3874
00000100:00080000:0.0:1776191341.818540:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1776191341.818546:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191341.818571:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000ad751c29 x1862467630900032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191341.818588:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191341.818591:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191341.818594:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1776191341.818595:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1776191341.818601:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3874
00000100:00080000:0.0:1776191341.818603:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1776191341.818607:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191341.818619:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000c0aeb4f4 x1862467630900096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191341.818643:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000095f6695f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630899968:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191341.818672:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002460ac97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630899776:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191341.818708:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191341.818713:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191341.818731:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd8aa733 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630900160:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191341.818747:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad751c29 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630900032:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191341.818759:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191341.818777:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191341.818795:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0aeb4f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630900096:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191341.818814:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191341.818817:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630899968
00000100:00100000:1.0:1776191341.818845:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630900032
00000100:00100000:0.0:1776191341.818860:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630900096
00000100:00100000:1.0:1776191341.818876:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1996
00000100:00100000:1.0:1776191341.818884:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016dc0009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630899968:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191341.818890:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2275
00000100:00100000:0.0:1776191341.818895:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000263400d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630900032:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191341.818935:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016dc0009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630899968:12345-0@lo:400:kworker/u8:2.0 Request processed in 51us (224us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191341.818943:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1996
00000100:00100000:1.0:1776191341.818960:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2276
00000100:00100000:1.0:1776191341.818963:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000950cd033 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630900096:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191341.819007:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191341.819066:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000263400d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630900032:12345-0@lo:8:kworker/u8:2.0 Request processed in 170us (290us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191341.819072:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2275
00010000:02020000:1.0:1776191341.819088:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191341.819092:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630899712
00000100:00100000:1.0:1776191341.819129:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000950cd033 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630900096:12345-0@lo:8:kworker/u8:2.0 Request processed in 164us (314us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191341.819131:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3123
00000100:00100000:0.0:1776191341.819140:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007756d7ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630899712:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191341.819141:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2276
00000100:00080000:1.0:1776191341.819186:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191341.819189:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191341.819192:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad751c29 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630900032:0@lo:8:kworker/u8:2.0
00000100:00080000:1.0:1776191341.819201:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191341.819204:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191341.819206:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0aeb4f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630900096:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191341.819236:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000095f6695f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630899968:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191341.819311:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007756d7ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630899712:12345-0@lo:400:kworker/u8:2.0 Request processed in 173us (719us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191341.819319:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3123
00000100:00100000:3.0:1776191341.819544:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630899776
00000100:00100000:3.0:1776191341.819578:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630900160
00000100:00100000:3.0:1776191341.819613:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4584
00000100:00100000:3.0:1776191341.819618:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049f07fc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630899776:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191341.819655:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049f07fc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630899776:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (948us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191341.819660:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4584
00000100:00100000:3.0:1776191341.819671:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4585
00000100:00100000:3.0:1776191341.819674:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bb77a7ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630900160:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191341.819696:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bb77a7ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630900160:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (939us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191341.819701:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4585
00000100:00100000:3.0:1776191341.819724:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a0f2d502 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630899584:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191341.819751:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191341.819767:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011caeb27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630899840:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191341.819795:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c2466414 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630899712:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191341.819913:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008735dcd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630899648:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191341.820068:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000041c7ca25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630900352:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191341.821831:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191341.821909:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d78e42e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630900224:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191341.821964:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191341.822083:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1776191341.822092:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a8f703ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630900288:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191341.822478:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191341.822528:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630899840
00000100:00100000:3.0:1776191341.822570:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3124
00000100:00100000:3.0:1776191341.822576:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d9f622e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630899840:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191341.822625:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d9f622e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630899840:12345-0@lo:400:kworker/u8:2.0 Request processed in 49us (801us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191341.822632:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3124
00000100:00100000:3.0:1776191341.822657:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630899584
00000100:00100000:3.0:1776191341.822678:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1726
00000100:00100000:3.0:1776191341.822682:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cef7ed6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630899584:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191341.822711:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cef7ed6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630899584:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (2960us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191341.822717:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1726
00000100:00100000:3.0:1776191341.822745:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630900288
00000100:00100000:3.0:1776191341.822765:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1575
00000100:00100000:3.0:1776191341.822769:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004250bccf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630900288:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191341.822791:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191341.822817:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004250bccf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630900288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (341us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191341.822823:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1575
00000100:00100000:3.0:1776191341.822842:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630900224
00000100:00100000:3.0:1776191341.822865:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4586
00000100:00100000:3.0:1776191341.822869:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bf4604b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630900224:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191341.822896:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bf4604b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630900224:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (932us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191341.822901:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4586
00000100:00100000:3.0:1776191341.822940:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a8f703ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630900288:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191341.822951:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a0f2d502 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630899584:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191341.822963:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011caeb27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630899840:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191341.822971:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d78e42e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630900224:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191341.823131:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002460ac97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630899776:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191341.823145:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd8aa733 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630900160:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191341.824938:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191341.824989:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006556f9ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630899904:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191341.825024:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191341.825188:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630899648
00000100:00100000:3.0:1776191341.825278:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4587
00000100:00100000:3.0:1776191341.825285:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036dae86d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630899648:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191341.825304:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630899904
00000100:00100000:3.0:1776191341.825345:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036dae86d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630899648:12345-0@lo:400:kworker/u8:2.0 Request processed in 58us (412us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191341.825347:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1997
00000100:00100000:0.0:1776191341.825356:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000481c290f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630899904:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191341.825358:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4587
00000100:00100000:0.0:1776191341.825401:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000481c290f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630899904:12345-0@lo:400:kworker/u8:2.0 Request processed in 45us (376us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191341.825408:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1997
00000100:00100000:1.0:1776191341.825620:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191341.827216:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008735dcd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630899648:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191341.827234:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006556f9ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630899904:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191341.830318:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630900352
00000100:00100000:0.0:1776191341.830391:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1576
00000100:00100000:0.0:1776191341.830398:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af393e55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630900352:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191341.830426:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191341.830515:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af393e55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630900352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (4896us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191341.830522:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1576
00000100:00100000:1.0:1776191341.830638:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000041c7ca25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630900352:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1776191342.586338:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191343.450586:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191343.450698:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191343.450796:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191343.450825:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191343.451103:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613794432
00000100:00100000:2.0:1776191343.451160:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1998
00000100:00100000:2.0:1776191343.451166:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e9827495 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613794432:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191343.451235:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e9827495 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613794432:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 68us (537us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191343.451243:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1998
00000100:00100000:2.0:1776191343.451280:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613794240
00000100:00100000:2.0:1776191343.451304:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1727
00000100:00100000:2.0:1776191343.451308:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000000cecea7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613794240:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191343.451332:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000000cecea7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613794240:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 23us (537us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191343.451338:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1727
00000100:00100000:3.0:1776191343.452387:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191343.452459:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613794496
00000100:00100000:1.0:1776191343.452495:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2277
00000100:00100000:1.0:1776191343.452500:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009af94ad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613794496:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:1.0:1776191343.452606:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191343.452657:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009af94ad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613794496:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 155us (273us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191343.452664:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2277
00000100:00100000:0.0:1776191343.452926:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613794304
00000100:00100000:0.0:1776191343.453009:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613794368
00000100:00100000:2.0:1776191343.453069:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4588
00000100:00100000:2.0:1776191343.453085:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a1967f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613794304:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191343.453156:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a1967f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613794304:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 80us (2590us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191343.453162:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4588
00000100:00100000:2.0:1776191343.453176:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4589
00000100:00100000:2.0:1776191343.453180:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c7bea5f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613794368:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191343.453202:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c7bea5f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613794368:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 22us (2378us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191343.453214:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4589
00010000:00010000:3.0:1776191343.610275:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191344.634408:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191344.891792:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003f01d2f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630900416:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191344.891864:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191344.892125:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630900416
00000100:00100000:2.0:1776191344.892176:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3125
00000100:00100000:2.0:1776191344.892183:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bd8aa733 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630900416:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191344.892220:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191344.892273:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bd8aa733 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630900416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (410us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191344.892283:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3125
00000100:00100000:0.0:1776191344.892425:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003f01d2f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630900416:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191345.658460:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191345.914309:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003f01d2f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630900480:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191345.914380:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191345.916224:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630900480
00000100:00100000:3.0:1776191345.919706:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3126
00000100:00100000:3.0:1776191345.919719:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002460ac97 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630900480:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191345.919759:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191345.919841:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002460ac97 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630900480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (5461us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191345.919921:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003f01d2f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630900480:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191345.933266:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3126
00010000:00010000:3.0:1776191346.684068:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191346.938621:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000041c7ca25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630900544:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191346.938732:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191346.939086:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630900544
00000100:00100000:1.0:1776191346.939174:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1577
00000100:00100000:1.0:1776191346.939181:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003f01d2f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630900544:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191346.939213:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191346.939267:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003f01d2f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630900544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (536us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191346.939275:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1577
00000100:00100000:0.0:1776191346.939360:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000012367763 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630900608:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191346.939378:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000041c7ca25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630900544:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191346.939407:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1776191346.939481:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191346.939486:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191346.939489:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191346.939494:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3879
00000100:00080000:2.0:1776191346.939496:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1776191346.939500:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191346.939517:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000000690142e x1862467630901056/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191346.939532:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191346.939535:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191346.939537:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191346.939540:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3879
00000100:00080000:2.0:1776191346.939541:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1776191346.939544:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191346.939554:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000c904ec5f x1862467630901120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191346.939585:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000049908ee0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630900736:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191346.939614:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191346.939630:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048d62137 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630900992:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191346.939664:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191346.939684:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:2.0:1776191346.939689:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000160230d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630900800:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191346.939715:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191346.939729:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c4e82865 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630901184:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191346.939750:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191346.939776:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630900736
00000100:00100000:2.0:1776191346.939800:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630901184
00000100:00100000:2.0:1776191346.939815:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4590
00000100:00100000:2.0:1776191346.939819:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a3b02dc8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630900736:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191346.939851:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a3b02dc8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630900736:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (238us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191346.939856:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4590
00000100:00100000:2.0:1776191346.939870:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4591
00000100:00100000:2.0:1776191346.939873:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a1548b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630901184:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191346.940932:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a1548b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630901184:12345-0@lo:400:kworker/u8:4.0 Request processed in 1056us (1180us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191346.940940:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4591
00000100:00100000:2.0:1776191346.940979:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c4e82865 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630901184:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191346.940988:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000049908ee0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630900736:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191346.941055:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630900992
00000100:00100000:2.0:1776191346.941082:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1999
00000100:00100000:2.0:1776191346.941085:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004a57869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630900992:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191346.941113:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004a57869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630900992:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (1449us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191346.941119:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1999
00000100:00100000:2.0:1776191346.941137:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048d62137 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630900992:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191346.941156:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630900800
00000100:00100000:2.0:1776191346.941176:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3127
00000100:00100000:2.0:1776191346.941180:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004831c73f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630900800:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191346.941209:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004831c73f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630900800:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (1494us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191346.941214:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3127
00000100:00100000:2.0:1776191346.941239:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000160230d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630900800:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191346.942390:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a2e3dc1e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630900672:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191346.942437:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191346.942462:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005fa5d8be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630900928:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191346.942486:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191346.942503:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:2.0:1776191346.942509:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002cd3d4b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630900864:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191346.942530:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191346.942545:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba9731d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630901248:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191346.942563:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191346.942594:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630900672
00000100:00100000:2.0:1776191346.942626:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1728
00000100:00100000:2.0:1776191346.942631:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e23389f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630900672:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191346.942680:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e23389f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630900672:12345-0@lo:400:kworker/u8:4.0 Request processed in 48us (243us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191346.942689:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1728
00000100:00100000:2.0:1776191346.942718:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630900928
00000100:00100000:2.0:1776191346.942740:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3128
00000100:00100000:2.0:1776191346.942743:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0fd09fc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630900928:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191346.942771:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0fd09fc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630900928:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (285us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191346.942777:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3128
00000100:00100000:2.0:1776191346.942795:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630900864
00000100:00100000:2.0:1776191346.942815:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630901248
00000100:00100000:2.0:1776191346.945468:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4592
00000100:00100000:2.0:1776191346.945480:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d20676ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630900864:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191346.945566:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d20676ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630900864:12345-0@lo:400:kworker/u8:4.0 Request processed in 87us (3035us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191346.945573:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4592
00000100:00100000:2.0:1776191346.945590:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4593
00000100:00100000:2.0:1776191346.945594:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000515eb3a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630901248:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191346.945623:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000515eb3a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630901248:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (3060us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191346.945628:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4593
00000100:00100000:2.0:1776191346.946375:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002cd3d4b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630900864:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191346.946392:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba9731d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630901248:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191346.946401:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a2e3dc1e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630900672:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191346.946422:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005fa5d8be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630900928:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191346.946495:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000690142e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630901056:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191346.946537:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191346.946555:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c904ec5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630901120:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191346.946572:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191346.946605:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630901056
00000100:00100000:2.0:1776191346.946628:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630901120
00000100:00100000:2.0:1776191346.946640:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2278
00000100:00100000:2.0:1776191346.946644:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f17e505c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630901056:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191346.946752:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191346.946784:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f17e505c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630901056:12345-0@lo:8:kworker/u8:4.0 Request processed in 139us (247us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191346.946790:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2278
00000100:00100000:2.0:1776191346.946802:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2279
00000100:00100000:2.0:1776191346.946805:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fc019f4b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630901120:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191346.946909:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191346.946942:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fc019f4b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630901120:12345-0@lo:8:kworker/u8:4.0 Request processed in 136us (369us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191346.946948:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2279
00000100:00080000:2.0:1776191346.946971:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191346.946975:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191346.946978:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000690142e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630901056:0@lo:8:kworker/u8:4.0
00000100:00080000:2.0:1776191346.946985:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191346.946988:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191346.946990:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c904ec5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630901120:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191346.951121:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630900608
00000100:00100000:3.0:1776191346.951186:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1578
00000100:00100000:3.0:1776191346.951192:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a0236b56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630900608:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191346.951219:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191346.951461:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a0236b56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630900608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 267us (12054us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191346.951469:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1578
00000100:00100000:0.0:1776191346.951615:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000012367763 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630900608:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1776191347.708053:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191348.573826:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191348.573875:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191348.573918:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191348.573952:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191348.573996:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613794752
00000100:00100000:3.0:1776191348.573998:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191348.574024:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613794816
00000100:00100000:0.0:1776191348.574086:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2000
00000100:00100000:3.0:1776191348.574097:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2280
00000100:00100000:0.0:1776191348.574099:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003bea0498 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613794752:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191348.574108:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b93c82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613794816:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00000100:00100000:2.0:1776191348.574120:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613794624
00000100:00100000:2.0:1776191348.574153:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613794688
00000100:00100000:0.0:1776191348.574177:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003bea0498 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613794752:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 82us (302us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191348.574190:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2000
00000100:00100000:2.0:1776191348.574191:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4594
00000100:00100000:2.0:1776191348.574199:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006605fbf0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613794624:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191348.574233:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006605fbf0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613794624:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 34us (415us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191348.574240:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4595
00000100:00100000:0.0:1776191348.574247:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad4a7212 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613794688:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191348.574275:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad4a7212 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613794688:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 28us (278us total) trans 0 rc 0/0
00010000:02020000:3.0:1776191348.574996:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191348.575064:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b93c82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613794816:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 959us (1113us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191348.575090:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2280
00000100:00100000:1.0:1776191348.575257:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613794560
00000100:00100000:1.0:1776191348.575306:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1729
00000100:00100000:1.0:1776191348.575311:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4da44d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613794560:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191348.575555:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4da44d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613794560:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 242us (1636us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191348.575563:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1729
00000100:00100000:2.0:1776191348.579611:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4594
00000100:00100000:0.0:1776191348.580062:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4595
00010000:00010000:3.0:1776191348.730339:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191349.755349:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191350.011317:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003f4bfd6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630901312:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191350.011393:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191350.011502:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630901312
00000100:00100000:3.0:1776191350.011557:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3129
00000100:00100000:3.0:1776191350.011563:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000012367763 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630901312:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191350.011597:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191350.011639:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000012367763 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630901312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (246us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191350.011647:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3129
00000100:00100000:0.0:1776191350.011735:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003f4bfd6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630901312:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191350.778839:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191351.034503:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b2914ae0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630901376:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191351.034576:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191351.034661:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630901376
00000100:00100000:0.0:1776191351.034706:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3130
00000100:00100000:0.0:1776191351.034711:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000041c7ca25 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630901376:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191351.034743:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191351.034809:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000041c7ca25 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630901376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (234us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191351.034815:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3130
00000100:00100000:1.0:1776191351.034895:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b2914ae0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630901376:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191351.802464:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1776191352.058689:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191352.058697:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191352.058700:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191352.058709:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3885
00000100:00080000:1.0:1776191352.058712:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1776191352.058718:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191352.058738:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000e555734e x1862467630901952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191352.058741:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae5c256c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630901440:0@lo:13:osp-pre-0-0.0
00000100:00080000:1.0:1776191352.058751:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191352.058754:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191352.058755:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191352.058758:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3885
00000100:00080000:1.0:1776191352.058759:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1776191352.058762:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191352.058769:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000640b7818 x1862467630902016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191352.058803:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191352.058848:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d8a67d69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630901696:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191352.058873:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191352.058905:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f74cc947 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630902080:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191352.058926:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191352.058941:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:3.0:1776191352.058946:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e2ce3f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630901632:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191352.058967:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191352.058980:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd153a77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630901888:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191352.058996:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191352.059030:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630901888
00000100:00100000:3.0:1776191352.059088:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2001
00000100:00100000:3.0:1776191352.059093:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009501226 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630901888:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191352.059138:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009501226 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630901888:12345-0@lo:400:kworker/u8:4.0 Request processed in 44us (140us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191352.059145:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2001
00000100:00100000:3.0:1776191352.059180:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd153a77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630901888:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191352.059254:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630901440
00000100:00100000:1.0:1776191352.059288:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1579
00000100:00100000:1.0:1776191352.059291:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006de4f7b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630901440:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191352.059312:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191352.059348:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006de4f7b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630901440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (546us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191352.059354:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1579
00000100:00100000:2.0:1776191352.059488:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a8f703ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630901504:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191352.059522:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191352.059538:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028951562 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630901760:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191352.059557:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191352.059564:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630901696
00000100:00100000:2.0:1776191352.059571:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e486c123 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630902144:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191352.059590:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630902080
00000100:00100000:2.0:1776191352.059590:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191352.059605:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:0.0:1776191352.059606:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630902144
00000100:00100000:2.0:1776191352.059609:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a63ab978 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630901568:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191352.059622:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4596
00000100:00100000:0.0:1776191352.059626:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008cc5f0ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630901696:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191352.059628:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191352.059640:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dfe84e20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630901824:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191352.059658:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008cc5f0ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630901696:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (785us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191352.059658:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191352.059664:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4596
00000100:00100000:0.0:1776191352.059674:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630901568
00000100:00100000:2.0:1776191352.059676:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e555734e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630901952:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191352.059686:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4597
00000100:00100000:0.0:1776191352.059689:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a5d3af6f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630902080:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191352.059696:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191352.059707:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000640b7818 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630902016:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191352.059710:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a5d3af6f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630902080:12345-0@lo:400:kworker/u8:4.0 Request processed in 20us (784us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191352.059715:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4597
00000100:00100000:2.0:1776191352.059723:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191352.059725:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4598
00000100:00100000:0.0:1776191352.059729:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001610a176 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630902144:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191352.059745:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4599
00000100:00100000:2.0:1776191352.059749:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009a58596b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630901568:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191352.059755:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001610a176 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630902144:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (165us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191352.059760:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4598
00000100:00100000:2.0:1776191352.059775:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009a58596b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630901568:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (146us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191352.059780:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4599
00000100:00100000:0.0:1776191352.059791:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630901632
00000100:00100000:2.0:1776191352.059795:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630901504
00000100:00100000:0.0:1776191352.059804:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630901760
00000100:00100000:0.0:1776191352.059814:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3131
00000100:00100000:2.0:1776191352.059814:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1730
00000100:00100000:0.0:1776191352.059818:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096b9f269 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630901632:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191352.059818:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e54e7edc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630901504:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191352.059930:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a63ab978 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630901568:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191352.059940:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e486c123 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630902144:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191352.059951:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191352.059957:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ede69d54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630902208:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191352.060115:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630901824
00000100:00100000:3.0:1776191352.060141:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630901952
00000100:00100000:3.0:1776191352.060154:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630902016
00000100:00100000:3.0:1776191352.060168:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2002
00000100:00100000:3.0:1776191352.060172:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a86d26af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630901824:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191352.064889:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096b9f269 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630901632:12345-0@lo:400:kworker/u8:4.0 Request processed in 5062us (5913us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191352.064916:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3131
00000100:00100000:0.0:1776191352.064950:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3132
00000100:00100000:0.0:1776191352.064957:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ccb6319 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630901760:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191352.065008:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ccb6319 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630901760:12345-0@lo:400:kworker/u8:4.0 Request processed in 52us (5450us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191352.065013:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3132
00000100:00100000:0.0:1776191352.065057:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2281
00000100:00100000:0.0:1776191352.065061:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000241a0ec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630901952:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191352.065151:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191352.065208:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000241a0ec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630901952:12345-0@lo:8:kworker/u8:4.0 Request processed in 145us (5511us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191352.065214:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2281
00000100:00100000:0.0:1776191352.065228:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2282
00000100:00100000:0.0:1776191352.065232:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000a8a89e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630902016:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191352.065311:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191352.065336:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000a8a89e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630902016:12345-0@lo:8:kworker/u8:4.0 Request processed in 103us (5612us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191352.065342:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2282
00000100:00100000:0.0:1776191352.065462:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e2ce3f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630901632:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191352.065474:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f74cc947 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630902080:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191352.065490:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae5c256c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630901440:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191352.065501:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d8a67d69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630901696:0@lo:400:kworker/u8:4.0
00000100:00080000:0.0:1776191352.065558:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191352.065562:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191352.065565:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e555734e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630901952:0@lo:8:kworker/u8:4.0
00000100:00080000:0.0:1776191352.065573:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191352.065575:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191352.065577:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000640b7818 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630902016:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191352.066202:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191352.066243:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028951562 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630901760:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191352.066320:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630902208
00000100:00100000:0.0:1776191352.066357:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1580
00000100:00100000:0.0:1776191352.066362:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e486c123 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630902208:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191352.066380:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191352.066418:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e486c123 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630902208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (219us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191352.066424:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1580
00000100:00100000:1.0:1776191352.066500:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ede69d54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630902208:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191352.066742:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a86d26af pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630901824:12345-0@lo:400:kworker/u8:4.0 Request processed in 6568us (7082us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191352.066750:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2002
00000100:00100000:2.0:1776191352.066831:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e54e7edc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630901504:12345-0@lo:400:kworker/u8:4.0 Request processed in 7012us (7308us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191352.066849:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1730
00000100:00100000:1.0:1776191352.066984:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dfe84e20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630901824:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191352.066993:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a8f703ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630901504:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191352.826734:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191353.691623:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191353.691669:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191353.691700:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191353.691721:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191353.691744:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191353.691776:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613795072
00000100:00100000:3.0:1776191353.691835:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613795136
00000100:00100000:3.0:1776191353.691852:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2003
00000100:00100000:3.0:1776191353.691869:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003239335f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613795072:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191353.691939:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003239335f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613795072:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 70us (218us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191353.691946:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2003
00000100:00100000:3.0:1776191353.691963:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2283
00000100:00100000:3.0:1776191353.691967:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000118d0482 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613795136:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:3.0:1776191353.692092:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191353.692119:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000118d0482 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613795136:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 152us (375us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191353.692125:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2283
00000100:00100000:2.0:1776191353.692304:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613794880
00000100:00100000:2.0:1776191353.692340:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1731
00000100:00100000:2.0:1776191353.692345:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f9ea876 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613794880:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191353.692377:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f9ea876 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613794880:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 31us (763us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191353.692384:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1731
00000100:00100000:0.0:1776191353.692473:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613795008
00000100:00100000:0.0:1776191353.692507:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613794944
00000100:00100000:0.0:1776191353.692527:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4600
00000100:00100000:0.0:1776191353.692532:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f5850781 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613795008:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191353.692561:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f5850781 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613795008:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 28us (893us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191353.692567:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4600
00000100:00100000:0.0:1776191353.692579:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4601
00000100:00100000:0.0:1776191353.692583:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004e5b784 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613794944:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191353.692606:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004e5b784 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613794944:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 22us (906us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191353.692614:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4601
00010000:00010000:3.0:1776191353.850369:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191354.874995:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191355.130516:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048e1f2c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630902272:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191355.130586:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191355.130658:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630902272
00000100:00100000:1.0:1776191355.130710:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3133
00000100:00100000:1.0:1776191355.130716:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006556f9ab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630902272:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191355.130745:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191355.130797:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006556f9ab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630902272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (212us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191355.130804:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3133
00000100:00100000:2.0:1776191355.130986:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048e1f2c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630902272:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191355.898248:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191356.154468:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191356.154483:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048e1f2c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630902336:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191356.154550:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191356.154960:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630902336
00000100:00100000:2.0:1776191356.155002:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3134
00000100:00100000:2.0:1776191356.155008:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008735dcd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630902336:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191356.155060:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191356.155107:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008735dcd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630902336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (558us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191356.155114:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3134
00000100:00100000:0.0:1776191356.155220:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048e1f2c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630902336:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191356.922548:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191357.178208:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:0.0:1776191357.178223:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d78e42e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630902464:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191357.178292:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191357.178333:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7fc0454 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630902400:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191357.178355:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1776191357.178504:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191357.178518:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191357.178522:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191357.178527:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3890
00000100:00080000:3.0:1776191357.178530:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1776191357.178535:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191357.178548:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000887bf0ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630902528:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191357.178554:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000009c1848a5 x1862467630902848/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191357.178568:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191357.178571:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191357.178572:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191357.178575:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3890
00000100:00100000:0.0:1776191357.178576:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1776191357.178587:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1776191357.178589:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000d20c9eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630902784:0@lo:400:kworker/u8:2.0
00000100:00080000:3.0:1776191357.178591:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191357.178600:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000000c128c04 x1862467630902912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191357.178609:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191357.178623:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191357.178627:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cec144c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630902720:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191357.178629:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000911fdeb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630902656:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191357.178649:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191357.178649:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191357.178663:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dcfa8951 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630903040:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191357.178668:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c1848a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630902848:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191357.178683:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191357.178687:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191357.178697:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:0.0:1776191357.178698:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000c128c04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630902912:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191357.178701:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000226faff2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630902592:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191357.178713:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191357.178716:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191357.178728:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007582ba84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630902976:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191357.178745:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630902528
00000100:00100000:3.0:1776191357.178746:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191357.178791:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1732
00000100:00100000:0.0:1776191357.178798:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000653a1d11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630902528:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191357.178806:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630902720
00000100:00100000:3.0:1776191357.178830:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630903040
00000100:00100000:0.0:1776191357.178842:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000653a1d11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630902528:12345-0@lo:400:kworker/u8:2.0 Request processed in 45us (266us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191357.178849:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1732
00000100:00100000:3.0:1776191357.178851:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630902592
00000100:00100000:3.0:1776191357.178864:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630902976
00000100:00100000:3.0:1776191357.178875:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4602
00000100:00100000:0.0:1776191357.178878:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4603
00000100:00100000:3.0:1776191357.178878:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000095f6695f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630902720:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191357.178881:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ae10efb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630903040:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191357.178920:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ae10efb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630903040:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (236us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191357.178924:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000095f6695f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630902720:12345-0@lo:400:kworker/u8:2.0 Request processed in 45us (276us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191357.178926:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4603
00000100:00100000:3.0:1776191357.178930:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4602
00000100:00100000:3.0:1776191357.178938:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4604
00000100:00100000:0.0:1776191357.178941:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4605
00000100:00100000:3.0:1776191357.178941:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2eb5de3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630902592:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191357.178944:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006be09a24 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630902976:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191357.178963:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006be09a24 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630902976:12345-0@lo:400:kworker/u8:2.0 Request processed in 19us (217us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191357.178963:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2eb5de3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630902592:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (246us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191357.178969:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4605
00000100:00100000:0.0:1776191357.178986:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630902848
00000100:00100000:0.0:1776191357.179003:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630902912
00000100:00100000:0.0:1776191357.179017:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2284
00000100:00100000:0.0:1776191357.179020:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0aeb4f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630902848:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191357.179135:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191357.179168:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0aeb4f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630902848:12345-0@lo:8:kworker/u8:2.0 Request processed in 147us (480us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191357.179174:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2284
00000100:00100000:0.0:1776191357.179185:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2285
00000100:00100000:0.0:1776191357.179189:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad751c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630902912:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191357.179269:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191357.179291:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad751c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630902912:12345-0@lo:8:kworker/u8:2.0 Request processed in 102us (578us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191357.179296:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2285
00000100:00080000:0.0:1776191357.179350:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191357.179353:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191357.179357:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c1848a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630902848:0@lo:8:kworker/u8:2.0
00000100:00080000:0.0:1776191357.179365:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191357.179367:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191357.179370:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000c128c04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630902912:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191357.179398:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000226faff2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630902592:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191357.179407:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4604
00000100:00100000:0.0:1776191357.179408:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007582ba84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630902976:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191357.179416:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dcfa8951 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630903040:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191357.179445:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630902784
00000100:00100000:0.0:1776191357.179446:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cec144c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630902720:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191357.179453:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000887bf0ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630902528:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191357.179466:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630902656
00000100:00100000:3.0:1776191357.179476:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3135
00000100:00100000:3.0:1776191357.179480:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c2466414 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630902784:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191357.179485:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3136
00000100:00100000:0.0:1776191357.179488:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001ca7e4d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630902656:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191357.179514:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001ca7e4d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630902656:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (864us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191357.179514:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c2466414 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630902784:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (904us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191357.179520:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3136
00000100:00100000:0.0:1776191357.179541:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000911fdeb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630902656:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191357.179570:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000d20c9eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630902784:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191357.179698:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3135
00000100:00100000:2.0:1776191357.182281:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630902464
00000100:00100000:2.0:1776191357.182804:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630902400
00000100:00100000:3.0:1776191357.182845:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1581
00000100:00100000:3.0:1776191357.182852:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000011caeb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630902464:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191357.182984:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191357.183095:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000011caeb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630902464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 242us (4804us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191357.183104:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1581
00000100:00100000:3.0:1776191357.183126:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1582
00000100:00100000:3.0:1776191357.183130:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a0f2d502 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630902400:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191357.183141:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191357.183248:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a0f2d502 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630902400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (4893us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191357.183255:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1582
00000100:00100000:0.0:1776191357.184231:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d78e42e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630902464:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191357.184253:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7fc0454 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630902400:0@lo:13:osp-pre-0-0.0
00010000:00010000:3.0:1776191357.947252:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191358.813871:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191358.813982:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191358.814024:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191358.814079:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191358.814101:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191358.814159:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613795456
00000100:00100000:0.0:1776191358.814197:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613795392
00000100:00100000:0.0:1776191358.814238:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2004
00000100:00100000:0.0:1776191358.814244:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cec144c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613795392:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191358.814316:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cec144c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613795392:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 70us (236us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191358.814323:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2004
00000100:00100000:0.0:1776191358.814340:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2286
00000100:00100000:0.0:1776191358.814344:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000911fdeb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613795456:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:0.0:1776191358.814436:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191358.814474:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000911fdeb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613795456:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 118us (482us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191358.814480:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2286
00000100:00100000:0.0:1776191358.814619:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613795200
00000100:00100000:0.0:1776191358.814644:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1733
00000100:00100000:0.0:1776191358.814648:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd6c2b01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613795200:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191358.814676:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd6c2b01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613795200:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 27us (653us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191358.814681:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1733
00000100:00100000:2.0:1776191358.816411:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613795264
00000100:00100000:2.0:1776191358.816660:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613795328
00000100:00100000:0.0:1776191358.816740:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4606
00000100:00100000:0.0:1776191358.816756:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000d20c9eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613795264:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191358.816838:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000d20c9eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613795264:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 81us (2974us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191358.816845:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4606
00000100:00100000:0.0:1776191358.816863:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4607
00000100:00100000:0.0:1776191358.816867:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dcfa8951 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613795328:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191358.816891:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dcfa8951 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613795328:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 23us (2790us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191358.816897:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4607
00010000:00010000:3.0:1776191358.970306:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191359.994830:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191360.252171:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001d7d2914 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630903104:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191360.252240:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191360.252347:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630903104
00000100:00100000:2.0:1776191360.252398:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3137
00000100:00100000:2.0:1776191360.252404:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003d78e42e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630903104:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191360.252438:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191360.252484:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003d78e42e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630903104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (244us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191360.252491:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3137
00000100:00100000:2.0:1776191360.252534:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001d7d2914 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630903104:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191361.018245:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191361.274496:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001d7d2914 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630903168:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191361.274568:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191361.276369:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630903168
00000100:00100000:3.0:1776191361.278079:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3138
00000100:00100000:3.0:1776191361.278273:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a8f703ac pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630903168:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191361.278318:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191361.278414:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a8f703ac pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630903168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 322us (3846us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191361.278422:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3138
00000100:00100000:0.0:1776191361.278964:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001d7d2914 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630903168:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191362.042560:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191362.298688:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000061ace3cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630903232:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191362.298758:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191362.298805:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776191362.298811:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f5a166e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630903296:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191362.298833:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191362.298982:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630903232
00000100:00100000:2.0:1776191362.299027:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630903296
00000100:00100000:2.0:1776191362.299075:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1583
00000100:00100000:2.0:1776191362.299081:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dfe84e20 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630903232:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191362.299111:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191362.299151:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dfe84e20 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630903232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (394us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191362.299159:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1583
00000100:00100000:2.0:1776191362.299175:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1584
00000100:00100000:2.0:1776191362.299179:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ede69d54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630903296:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191362.299189:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191362.299209:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ede69d54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630903296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 30us (376us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191362.299215:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1584
00000100:00100000:1.0:1776191362.299302:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f5a166e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630903296:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191362.299316:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000061ace3cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630903232:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191362.302910:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ecd900ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630903488:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191362.302976:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191362.303062:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003af595e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630903360:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191362.303098:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191362.303120:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776191362.303125:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d55fd4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630903424:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191362.303149:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191362.303178:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630903360
00000100:00100000:0.0:1776191362.303217:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1734
00000100:00100000:0.0:1776191362.303223:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000040bbf344 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630903360:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191362.303270:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000040bbf344 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630903360:12345-0@lo:400:kworker/u8:4.0 Request processed in 47us (173us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191362.303281:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1734
00000100:00100000:0.0:1776191362.303326:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630903424
00000100:00100000:0.0:1776191362.303352:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4608
00000100:00100000:0.0:1776191362.303356:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc36af09 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630903424:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191362.303400:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc36af09 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630903424:12345-0@lo:400:kworker/u8:4.0 Request processed in 43us (251us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191362.303406:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4608
00000100:00100000:0.0:1776191362.303443:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d55fd4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630903424:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191362.303452:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003af595e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630903360:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191362.303495:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630903488
00000100:00100000:0.0:1776191362.303517:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3139
00000100:00100000:0.0:1776191362.303521:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007582ba84 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630903488:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191362.304915:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b92c4097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630903552:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191362.304961:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191362.305051:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630903552
00000100:00100000:1.0:1776191362.305078:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4609
00000100:00100000:1.0:1776191362.305083:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028951562 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630903552:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191362.305119:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028951562 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630903552:12345-0@lo:400:kworker/u8:4.0 Request processed in 36us (159us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191362.305124:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4609
00000100:00100000:1.0:1776191362.305152:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b92c4097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630903552:0@lo:400:kworker/u8:4.0
00000100:00080000:2.0:1776191362.307323:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191362.307330:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191362.307334:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191362.307342:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3895
00000100:00080000:2.0:1776191362.307345:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1776191362.307350:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191362.307373:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000b92c4097 x1862467630903680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191362.307399:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191362.307401:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191362.307403:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191362.307405:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3895
00000100:00080000:2.0:1776191362.307407:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1776191362.307409:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191362.307418:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000003af595e4 x1862467630903744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191362.309071:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d55fd4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630903808:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191362.309139:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191362.309172:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191362.309177:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a96a54e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630903616:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191362.309199:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191362.309220:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776191362.309226:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f5a166e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630903872:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191362.309246:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191362.309275:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630903808
00000100:00100000:1.0:1776191362.309312:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630903872
00000100:00100000:1.0:1776191362.309331:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4610
00000100:00100000:1.0:1776191362.309336:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a63ab978 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630903808:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191362.309378:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a63ab978 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630903808:12345-0@lo:400:kworker/u8:4.0 Request processed in 42us (239us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191362.309395:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4610
00000100:00100000:1.0:1776191362.309410:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4611
00000100:00100000:1.0:1776191362.309413:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000da5c05bb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630903872:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191362.309437:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000da5c05bb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630903872:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (191us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191362.309442:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4611
00000100:00100000:1.0:1776191362.309478:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f5a166e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630903872:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191362.309507:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d55fd4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630903808:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191362.309524:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630903616
00000100:00100000:1.0:1776191362.309547:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3140
00000100:00100000:1.0:1776191362.309551:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006644a6e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630903616:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191362.309581:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006644a6e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630903616:12345-0@lo:400:kworker/u8:4.0 Request processed in 29us (382us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191362.309586:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3140
00000100:00100000:1.0:1776191362.309606:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a96a54e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630903616:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191362.309660:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b92c4097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630903680:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191362.309696:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191362.309712:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003af595e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630903744:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191362.309730:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191362.309757:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630903680
00000100:00100000:1.0:1776191362.309774:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630903744
00000100:00100000:1.0:1776191362.309787:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2287
00000100:00100000:1.0:1776191362.309791:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000640b7818 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630903680:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191362.309885:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191362.309918:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000640b7818 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630903680:12345-0@lo:8:kworker/u8:4.0 Request processed in 125us (221us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191362.309924:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2287
00000100:00100000:1.0:1776191362.309934:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2288
00000100:00100000:1.0:1776191362.309937:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e555734e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630903744:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191362.310016:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191362.310065:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e555734e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630903744:12345-0@lo:8:kworker/u8:4.0 Request processed in 126us (334us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191362.310070:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2288
00000100:00080000:1.0:1776191362.310092:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191362.310095:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191362.310098:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b92c4097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630903680:0@lo:8:kworker/u8:4.0
00000100:00080000:1.0:1776191362.310107:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191362.310110:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191362.310111:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003af595e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630903744:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191362.312880:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007582ba84 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630903488:12345-0@lo:400:kworker/u8:4.0 Request processed in 9350us (9896us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191362.312896:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3139
00000100:00100000:3.0:1776191362.315463:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ecd900ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630903488:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191363.066475:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191363.933157:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191363.933246:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191363.933345:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613795584
00000100:00100000:0.0:1776191363.933402:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4612
00000100:00100000:0.0:1776191363.933409:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8a67d69 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613795584:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191363.933486:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8a67d69 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613795584:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 76us (240us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191363.933493:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4612
00000100:00100000:2.0:1776191363.933751:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613795520
00000100:00100000:2.0:1776191363.933823:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1735
00000100:00100000:2.0:1776191363.933828:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bbf84eea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613795520:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191363.933963:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bbf84eea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613795520:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 133us (813us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191363.933970:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1735
00000100:00100000:1.0:1776191363.938426:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191363.938468:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191363.938506:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191363.938675:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613795712
00000100:00100000:3.0:1776191363.938757:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613795648
00000100:00100000:3.0:1776191363.938802:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4613
00000100:00100000:3.0:1776191363.938810:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bd153a77 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613795648:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191363.938848:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613795776
00000100:00100000:2.0:1776191363.938856:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2005
00000100:00100000:2.0:1776191363.938864:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f74cc947 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613795712:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191363.938873:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2289
00000100:00100000:0.0:1776191363.938879:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e2ce3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613795776:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00000100:00100000:2.0:1776191363.938935:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f74cc947 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613795712:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 71us (526us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191363.938944:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2005
00010000:02020000:0.0:1776191363.938973:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191363.939019:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e2ce3f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613795776:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 139us (550us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191363.939027:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2289
00000100:00100000:3.0:1776191363.939357:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bd153a77 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613795648:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 546us (851us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191363.939365:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4613
00010000:00010000:0.0:1776191364.090966:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191365.114510:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191365.370265:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001d7d2914 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630903936:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191365.370336:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191365.370447:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630903936
00000100:00100000:0.0:1776191365.370495:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3141
00000100:00100000:0.0:1776191365.370501:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e56aacf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630903936:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191365.370534:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191365.370590:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e56aacf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630903936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (254us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191365.370597:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3141
00000100:00100000:2.0:1776191365.370665:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001d7d2914 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630903936:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191366.141833:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191366.395723:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b81e3ace pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630904000:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191366.395801:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191366.396021:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630904000
00000100:00100000:3.0:1776191366.396097:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3142
00000100:00100000:3.0:1776191366.396103:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000061ace3cb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630904000:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191366.396135:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191366.396188:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000061ace3cb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630904000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (388us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191366.396195:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3142
00000100:00100000:1.0:1776191366.396262:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b81e3ace pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630904000:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191367.165940:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191367.418467:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191367.418484:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000887bf0ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630904064:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191367.418555:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191367.418684:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630904064
00000100:00100000:0.0:1776191367.418743:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1585
00000100:00100000:0.0:1776191367.418750:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000c128c04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630904064:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191367.418781:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191367.418830:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000c128c04 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630904064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (280us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191367.418837:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1585
00000100:00100000:3.0:1776191367.418926:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000887bf0ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630904064:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191367.419366:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776191367.419377:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001d7d2914 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630904128:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191367.419411:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191367.419495:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630904128
00000100:00100000:2.0:1776191367.419530:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1586
00000100:00100000:2.0:1776191367.419534:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3b69bbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630904128:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191367.419546:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191367.419604:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3b69bbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630904128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (193us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191367.419610:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1586
00000100:00100000:1.0:1776191367.419894:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001d7d2914 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630904128:0@lo:13:osp-pre-0-0.0
00000100:00080000:0.0:1776191367.420526:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191367.420531:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191367.420535:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191367.420540:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3900
00000100:00080000:0.0:1776191367.420543:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1776191367.420547:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191367.420573:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000887bf0ab x1862467630904512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191367.420585:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191367.420588:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191367.420589:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191367.420591:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3900
00000100:00080000:0.0:1776191367.420593:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1776191367.420595:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191367.420607:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000009b397ad6 x1862467630904576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191367.420675:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba296d84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630904384:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191367.420726:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191367.420757:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:3.0:1776191367.420763:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000226faff2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630904192:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191367.420794:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191367.420809:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000589db251 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630904448:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191367.420829:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191367.420857:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630904192
00000100:00100000:3.0:1776191367.420886:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1736
00000100:00100000:3.0:1776191367.420891:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000351c4067 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630904192:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191367.420940:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000351c4067 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630904192:12345-0@lo:400:kworker/u8:2.0 Request processed in 48us (145us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191367.420946:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1736
00000100:00100000:3.0:1776191367.420974:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630904448
00000100:00100000:3.0:1776191367.420996:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3143
00000100:00100000:3.0:1776191367.421000:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d06252d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630904448:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191367.421027:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d06252d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630904448:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (198us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191367.421058:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3143
00000100:00100000:3.0:1776191367.421086:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000226faff2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630904192:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191367.421095:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000589db251 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630904448:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191367.421200:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630904384
00000100:00100000:0.0:1776191367.421238:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4614
00000100:00100000:0.0:1776191367.421243:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c1848a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630904384:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191367.421280:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c1848a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630904384:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (555us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191367.421287:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4614
00000100:00100000:2.0:1776191367.421347:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000767f2c7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630904256:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191367.421375:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191367.421397:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008058b273 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630904640:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191367.421416:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191367.421432:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:2.0:1776191367.421437:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bbd900df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630904320:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191367.421456:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191367.421467:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008e14e826 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630904704:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191367.421484:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191367.421544:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630904256
00000100:00100000:0.0:1776191367.421582:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630904640
00000100:00100000:0.0:1776191367.421599:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630904704
00000100:00100000:0.0:1776191367.421614:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4615
00000100:00100000:0.0:1776191367.421617:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dcd4c128 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630904256:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191367.421655:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dcd4c128 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630904256:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (280us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191367.421660:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4615
00000100:00100000:0.0:1776191367.421670:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4616
00000100:00100000:0.0:1776191367.421673:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e7fc0454 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630904640:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191367.421694:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e7fc0454 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630904640:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (277us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191367.421699:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4616
00000100:00100000:0.0:1776191367.421708:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4617
00000100:00100000:0.0:1776191367.421710:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae5c256c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630904704:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191367.421732:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae5c256c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630904704:12345-0@lo:400:kworker/u8:2.0 Request processed in 20us (247us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191367.421737:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4617
00000100:00100000:0.0:1776191367.421767:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008e14e826 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630904704:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191367.421782:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000767f2c7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630904256:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191367.421789:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008058b273 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630904640:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191367.422116:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630904320
00000100:00100000:3.0:1776191367.422149:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3144
00000100:00100000:3.0:1776191367.422153:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048e1f2c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630904320:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191367.422196:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048e1f2c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630904320:12345-0@lo:400:kworker/u8:2.0 Request processed in 42us (739us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191367.422201:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3144
00000100:00100000:3.0:1776191367.422227:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba296d84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630904384:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191367.422290:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bbd900df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630904320:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191367.422353:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000887bf0ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630904512:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191367.422387:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191367.422413:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b397ad6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630904576:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191367.422434:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191367.422554:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630904512
00000100:00100000:3.0:1776191367.422591:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630904576
00000100:00100000:3.0:1776191367.422611:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2290
00000100:00100000:3.0:1776191367.422615:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b81e3ace pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630904512:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191367.422715:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191367.422748:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b81e3ace pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630904512:12345-0@lo:8:kworker/u8:2.0 Request processed in 132us (361us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191367.422754:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2290
00000100:00100000:3.0:1776191367.422764:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2291
00000100:00100000:3.0:1776191367.422767:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c7c28c8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630904576:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191367.422845:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191367.422867:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c7c28c8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630904576:12345-0@lo:8:kworker/u8:2.0 Request processed in 100us (434us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191367.422873:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2291
00000100:00080000:1.0:1776191367.423782:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191367.423790:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191367.423795:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000887bf0ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630904512:0@lo:8:kworker/u8:2.0
00000100:00080000:1.0:1776191367.423805:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191367.423807:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191367.423810:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b397ad6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630904576:0@lo:8:kworker/u8:2.0
00010000:00010000:3.0:1776191368.186583:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191369.053887:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191369.054000:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191369.054051:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191369.054117:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613795904
00000100:00100000:2.0:1776191369.054178:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4618
00000100:00100000:2.0:1776191369.054185:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bf73ce67 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613795904:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191369.054258:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bf73ce67 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613795904:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 72us (258us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191369.054266:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4618
00000100:00100000:1.0:1776191369.055192:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191369.055228:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191369.055289:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613795840
00000100:00100000:3.0:1776191369.055329:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1737
00000100:00100000:3.0:1776191369.055335:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048ed839b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613795840:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191369.055378:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048ed839b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613795840:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 41us (188us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191369.055385:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1737
00000100:00100000:3.0:1776191369.055413:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613795968
00000100:00100000:3.0:1776191369.055437:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4619
00000100:00100000:3.0:1776191369.055441:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000005d27964 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613795968:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191369.055488:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000005d27964 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613795968:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 46us (261us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191369.055495:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4619
00000100:00100000:0.0:1776191369.056282:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613796096
00000100:00100000:0.0:1776191369.056365:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613796032
00000100:00100000:2.0:1776191369.056431:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2006
00000100:00100000:2.0:1776191369.056438:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000069413549 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613796032:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191369.056510:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000069413549 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613796032:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 72us (2476us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191369.056517:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2006
00000100:00100000:2.0:1776191369.056542:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2292
00000100:00100000:2.0:1776191369.056545:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a81e70bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613796096:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:2.0:1776191369.056640:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191369.056668:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a81e70bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613796096:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 122us (2789us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191369.056675:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2292
00010000:00010000:3.0:1776191369.212134:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191370.234328:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191370.494137:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b2914ae0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630904768:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191370.494209:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191370.494307:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630904768
00000100:00100000:2.0:1776191370.494355:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3145
00000100:00100000:2.0:1776191370.494361:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096baf6e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630904768:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191370.494404:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191370.494458:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096baf6e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630904768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (250us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191370.494465:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3145
00000100:00100000:1.0:1776191370.494544:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b2914ae0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630904768:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191371.258385:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191371.514246:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d5dde41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630904832:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191371.514322:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191371.514354:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630904832
00000100:00100000:3.0:1776191371.514406:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3146
00000100:00100000:3.0:1776191371.514412:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003f4bfd6c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630904832:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191371.514446:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191371.514508:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003f4bfd6c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630904832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (187us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191371.514516:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3146
00000100:00100000:1.0:1776191371.514640:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d5dde41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630904832:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191372.286848:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191372.538235:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008058b273 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630904896:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191372.538318:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1776191372.538356:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191372.538362:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191372.538366:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1776191372.538369:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003af595e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630905152:0@lo:400:kworker/u8:4.0
00000100:00080000:2.0:1776191372.538372:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3905
00000100:00080000:2.0:1776191372.538387:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1776191372.538393:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191372.538400:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191372.538420:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:2.0:1776191372.538421:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000007f5a166e x1862467630905408/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191372.538428:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b2914ae0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630904960:0@lo:400:kworker/u8:4.0
00000100:00080000:2.0:1776191372.538442:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191372.538446:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191372.538455:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191372.538458:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3905
00000100:00080000:2.0:1776191372.538460:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1776191372.538463:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191372.538475:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000048199cde x1862467630905472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191372.538485:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191372.538504:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b92c4097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630905216:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191372.538527:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191372.538549:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630905152
00000100:00100000:3.0:1776191372.538550:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000102502dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630905536:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191372.538577:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191372.538624:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630904896
00000100:00100000:0.0:1776191372.538652:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1587
00000100:00100000:0.0:1776191372.538658:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d1e8454 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630904896:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191372.538685:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191372.538725:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d1e8454 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630904896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (409us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191372.538731:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1587
00000100:00100000:1.0:1776191372.538831:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fadf7139 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630905600:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191372.538865:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ecd900ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630905088:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191372.538886:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191372.538901:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d55fd4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630905344:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191372.538920:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191372.538934:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:1.0:1776191372.538939:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001d7d2914 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630905024:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191372.538960:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f5a166e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630905408:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191372.538978:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191372.538992:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048199cde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630905472:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191372.539009:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191372.539050:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630904960
00000100:00100000:1.0:1776191372.539074:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1738
00000100:00100000:1.0:1776191372.539078:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000062c92fc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630904960:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191372.539106:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000062c92fc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630904960:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (625us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191372.539112:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1738
00000100:00100000:1.0:1776191372.539138:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630905344
00000100:00100000:1.0:1776191372.539158:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630905408
00000100:00100000:1.0:1776191372.539170:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630905472
00000100:00100000:1.0:1776191372.539182:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2007
00000100:00100000:1.0:1776191372.539185:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000054825189 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630905344:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191372.539216:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000054825189 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630905344:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (295us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191372.539222:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2007
00000100:00100000:1.0:1776191372.539233:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2293
00000100:00100000:1.0:1776191372.539235:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ca51694 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630905408:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191372.539337:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191372.539365:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ca51694 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630905408:12345-0@lo:8:kworker/u8:4.0 Request processed in 128us (386us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191372.539371:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2293
00000100:00100000:1.0:1776191372.539383:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2294
00000100:00100000:1.0:1776191372.539386:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ed42626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630905472:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191372.539491:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191372.539513:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ed42626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630905472:12345-0@lo:8:kworker/u8:4.0 Request processed in 126us (504us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191372.539519:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2294
00000100:00100000:1.0:1776191372.539577:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b5928219 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630905664:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191372.539601:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191372.539634:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191372.539638:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191372.539640:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f5a166e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630905408:0@lo:8:kworker/u8:4.0
00000100:00080000:1.0:1776191372.539648:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191372.539649:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191372.539651:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048199cde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630905472:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191372.539678:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630905216
00000100:00100000:1.0:1776191372.539698:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630905088
00000100:00100000:1.0:1776191372.539707:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3147
00000100:00100000:1.0:1776191372.539711:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070c80d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630905216:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191372.539737:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070c80d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630905216:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (1210us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191372.539743:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3147
00000100:00100000:1.0:1776191372.539752:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3148
00000100:00100000:1.0:1776191372.539755:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d5dde41 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630905088:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191372.539780:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d5dde41 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630905088:12345-0@lo:400:kworker/u8:4.0 Request processed in 24us (894us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191372.539785:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3148
00000100:00100000:1.0:1776191372.539839:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630905664
00000100:00100000:1.0:1776191372.539858:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1588
00000100:00100000:1.0:1776191372.539861:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f43f1e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630905664:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191372.539872:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191372.539900:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f43f1e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630905664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (299us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191372.539905:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1588
00000100:00100000:1.0:1776191372.539930:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b5928219 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630905664:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191372.543219:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b2914ae0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630904960:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191372.543242:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b92c4097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630905216:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191372.543277:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008058b273 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630904896:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191372.543347:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191372.543470:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630905536
00000100:00100000:2.0:1776191372.543516:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4620
00000100:00100000:2.0:1776191372.543522:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002c9bae2d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630905152:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191372.543588:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002c9bae2d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630905152:12345-0@lo:400:kworker/u8:4.0 Request processed in 66us (5190us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191372.543595:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4620
00000100:00100000:2.0:1776191372.543611:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4621
00000100:00100000:2.0:1776191372.543615:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000c128c04 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630905536:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191372.543640:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000c128c04 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630905536:12345-0@lo:400:kworker/u8:4.0 Request processed in 24us (5064us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191372.543645:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4621
00000100:00100000:2.0:1776191372.543695:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000102502dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630905536:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191372.543709:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003af595e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630905152:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191372.547489:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191372.547517:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a96a54e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630905280:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191372.547578:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191372.547616:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ecd900ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630905088:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191372.547630:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d55fd4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630905344:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191372.547668:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630905280
00000100:00100000:3.0:1776191372.547711:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2008
00000100:00100000:3.0:1776191372.547717:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba296d84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630905280:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191372.547722:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630905600
00000100:00100000:1.0:1776191372.547765:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630905024
00000100:00100000:3.0:1776191372.547775:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba296d84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630905280:12345-0@lo:400:kworker/u8:4.0 Request processed in 56us (195us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191372.547784:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2008
00000100:00100000:1.0:1776191372.547788:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4622
00000100:00100000:1.0:1776191372.547794:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000887bf0ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630905600:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191372.547837:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a96a54e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630905280:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191372.547840:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000887bf0ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630905600:12345-0@lo:400:kworker/u8:4.0 Request processed in 44us (4492us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191372.547850:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4622
00000100:00100000:1.0:1776191372.547867:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4623
00000100:00100000:3.0:1776191372.547869:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fadf7139 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630905600:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191372.547874:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bbd900df pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630905024:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191372.547916:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bbd900df pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630905024:12345-0@lo:400:kworker/u8:4.0 Request processed in 43us (433us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191372.547922:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4623
00000100:00100000:3.0:1776191372.547926:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001d7d2914 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630905024:0@lo:400:kworker/u8:4.0
00010000:00010000:0.0:1776191373.306526:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191374.171477:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191374.171550:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191374.171578:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191374.171610:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191374.171668:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191374.171703:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613796352
00000100:00100000:3.0:1776191374.171741:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613796416
00000100:00100000:3.0:1776191374.171755:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2009
00000100:00100000:3.0:1776191374.171761:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000226faff2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613796352:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191374.171820:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000226faff2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613796352:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 59us (211us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191374.171827:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2009
00000100:00100000:3.0:1776191374.171841:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2295
00000100:00100000:3.0:1776191374.171844:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005112615a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613796416:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:3.0:1776191374.171960:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191374.171989:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005112615a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613796416:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 144us (322us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191374.171996:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2295
00000100:00100000:0.0:1776191374.172187:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613796288
00000100:00100000:0.0:1776191374.172231:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613796224
00000100:00100000:0.0:1776191374.172255:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4624
00000100:00100000:0.0:1776191374.172260:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000767f2c7b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613796288:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191374.172293:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000767f2c7b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613796288:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 32us (744us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191374.172299:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4624
00000100:00100000:0.0:1776191374.172312:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4625
00000100:00100000:0.0:1776191374.172315:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000589db251 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613796224:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191374.172332:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000589db251 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613796224:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 16us (755us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191374.172348:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4625
00000100:00100000:1.0:1776191374.174567:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613796160
00000100:00100000:1.0:1776191374.174749:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1739
00000100:00100000:1.0:1776191374.174756:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c45da90d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613796160:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191374.174835:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c45da90d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613796160:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 78us (3366us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191374.174843:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1739
00010000:00010000:3.0:1776191374.337645:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191375.354380:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191375.611142:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000102502dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630905728:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191375.611209:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191375.611312:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630905728
00000100:00100000:0.0:1776191375.611370:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3149
00000100:00100000:0.0:1776191375.611376:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a102519 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630905728:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191375.611422:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191375.611473:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a102519 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630905728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (265us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191375.611479:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3149
00000100:00100000:3.0:1776191375.611630:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000102502dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630905728:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191376.378870:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191376.636095:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191376.636116:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b5928219 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630905792:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191376.636179:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191376.636687:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630905792
00000100:00100000:1.0:1776191376.636769:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3150
00000100:00100000:1.0:1776191376.636775:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e14e826 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630905792:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191376.636807:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191376.636866:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e14e826 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630905792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (679us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191376.636873:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3150
00000100:00100000:3.0:1776191376.636943:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b5928219 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630905792:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191377.410825:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191377.658241:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191377.658259:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003462e3ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630905856:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191377.658285:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e30dc2ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630905920:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191377.658329:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1776191377.658532:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191377.658537:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191377.658540:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191377.658545:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3910
00000100:00080000:0.0:1776191377.658548:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1776191377.658553:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191377.658572:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000001a6e01f5 x1862467630906368/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191377.658574:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630905856
00000100:00080000:0.0:1776191377.658589:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191377.658593:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191377.658595:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191377.658598:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3910
00000100:00080000:0.0:1776191377.658600:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1776191377.658604:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191377.658616:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000d72c3363 x1862467630906432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191377.658619:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1589
00000100:00100000:1.0:1776191377.658628:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008c618d84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630905856:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191377.658655:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002418d9f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630906048:0@lo:400:kworker/u8:2.0
00002000:00000024:1.0:1776191377.658658:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191377.658688:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191377.658706:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6387b57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630906304:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191377.658727:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191377.658742:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:0.0:1776191377.658747:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000081c04e2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630906112:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191377.658769:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191377.658781:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004270d9b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630906496:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191377.658797:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008c618d84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630905856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 169us (468us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191377.658807:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1589
00000100:00100000:1.0:1776191377.658833:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a6e01f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630906368:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191377.658861:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191377.659068:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191377.659106:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003462e3ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630905856:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191377.659172:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d72c3363 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630906432:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191377.659196:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191377.659259:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630906048
00000100:00100000:2.0:1776191377.659287:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630906496
00000100:00100000:2.0:1776191377.659305:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4626
00000100:00100000:2.0:1776191377.659309:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000007ef2a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630906048:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191377.659372:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000007ef2a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630906048:12345-0@lo:400:kworker/u8:2.0 Request processed in 62us (685us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191377.659383:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4626
00000100:00100000:2.0:1776191377.659397:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4627
00000100:00100000:2.0:1776191377.659400:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000083dffaa0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630906496:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191377.659440:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000083dffaa0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630906496:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (636us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191377.659445:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4627
00000100:00100000:2.0:1776191377.659471:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191377.659492:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000025b75de1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630906176:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191377.659513:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191377.659781:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ce1e2ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630906560:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191377.659819:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191377.659836:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:2.0:1776191377.659842:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008eb36e2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630905984:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191377.659866:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191377.659881:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000939496a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630906240:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191377.659900:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191377.659926:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630905984
00000100:00100000:2.0:1776191377.659953:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1740
00000100:00100000:2.0:1776191377.659957:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002aaf4bb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630905984:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191377.659987:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002aaf4bb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630905984:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (120us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191377.659993:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1740
00000100:00100000:2.0:1776191377.660017:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630906112
00000100:00100000:2.0:1776191377.660055:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630906240
00000100:00100000:2.0:1776191377.660066:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3151
00000100:00100000:2.0:1776191377.660070:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001fbd73a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630906112:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191377.660098:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001fbd73a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630906112:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (1329us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191377.660104:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3151
00000100:00100000:2.0:1776191377.660114:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3152
00000100:00100000:2.0:1776191377.660118:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048199cde pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630906240:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191377.660152:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048199cde pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630906240:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (251us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191377.660157:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3152
00000100:00100000:2.0:1776191377.660179:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630906176
00000100:00100000:2.0:1776191377.660196:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630906560
00000100:00100000:2.0:1776191377.660214:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4628
00000100:00100000:2.0:1776191377.660218:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000102502dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630906176:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191377.660246:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000102502dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630906176:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (732us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191377.660251:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4628
00000100:00100000:2.0:1776191377.660262:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4629
00000100:00100000:2.0:1776191377.660265:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fadf7139 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630906560:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191377.660286:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fadf7139 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630906560:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (483us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191377.660291:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4629
00000100:00100000:2.0:1776191377.660322:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008eb36e2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630905984:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191377.660331:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000939496a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630906240:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191377.660350:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000025b75de1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630906176:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191377.660359:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ce1e2ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630906560:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191377.660393:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000081c04e2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630906112:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191377.660402:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004270d9b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630906496:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191377.660412:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002418d9f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630906048:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191377.660537:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630905920
00000100:00100000:3.0:1776191377.660564:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1590
00000100:00100000:3.0:1776191377.660568:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001648d249 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630905920:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191377.660581:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191377.660615:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001648d249 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630905920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (1143us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191377.660621:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1590
00000100:00100000:3.0:1776191377.660656:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e30dc2ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630905920:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191377.670438:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630906304
00000100:00100000:0.0:1776191377.670698:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630906368
00000100:00100000:2.0:1776191377.670745:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630906432
00000100:00100000:1.0:1776191377.675493:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2010
00000100:00100000:1.0:1776191377.675646:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e7a43fc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630906304:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191377.675684:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2296
00000100:00100000:3.0:1776191377.675690:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000536c40e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630906368:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191377.675798:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191377.675851:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000536c40e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630906368:12345-0@lo:8:kworker/u8:2.0 Request processed in 160us (16988us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191377.675992:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e7a43fc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630906304:12345-0@lo:400:kworker/u8:2.0 Request processed in 488us (17263us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191377.676702:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2296
00000100:00100000:1.0:1776191377.676721:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2010
00000100:00100000:3.0:1776191377.676731:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2297
00000100:00100000:3.0:1776191377.676737:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019e5e056 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630906432:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191377.676825:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191377.676866:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019e5e056 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630906432:12345-0@lo:8:kworker/u8:2.0 Request processed in 129us (17670us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191377.676873:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2297
00000100:00080000:0.0:1776191377.677270:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191377.677275:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191377.677280:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a6e01f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630906368:0@lo:8:kworker/u8:2.0
00000100:00080000:0.0:1776191377.677291:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191377.677293:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191377.677295:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d72c3363 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630906432:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191377.677461:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6387b57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630906304:0@lo:400:kworker/u8:2.0
00010000:00010000:3.0:1776191378.426485:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191379.295679:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191379.295732:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191379.295772:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191379.295802:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191379.295869:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191379.295929:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613796480
00000100:00100000:0.0:1776191379.295983:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1741
00000100:00100000:0.0:1776191379.295989:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027ca70f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613796480:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191379.296079:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027ca70f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613796480:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 89us (306us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191379.296086:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1741
00000100:00100000:2.0:1776191379.296559:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613796544
00000100:00100000:2.0:1776191379.296610:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613796608
00000100:00100000:2.0:1776191379.296636:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4630
00000100:00100000:2.0:1776191379.296640:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b81e3ace pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613796544:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191379.296681:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b81e3ace pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613796544:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 39us (1009us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191379.296687:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4630
00000100:00100000:2.0:1776191379.296700:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4631
00000100:00100000:2.0:1776191379.296704:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000069413549 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613796608:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191379.296726:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000069413549 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613796608:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 22us (925us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191379.296733:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4631
00000100:00100000:2.0:1776191379.296754:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613796672
00000100:00100000:2.0:1776191379.296774:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613796736
00000100:00100000:2.0:1776191379.296791:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2011
00000100:00100000:2.0:1776191379.296795:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c7c28c8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613796672:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191379.296819:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c7c28c8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613796672:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 23us (1087us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191379.296826:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2011
00000100:00100000:2.0:1776191379.296838:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2298
00000100:00100000:2.0:1776191379.296842:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a81e70bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613796736:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:2.0:1776191379.296936:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191379.296966:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a81e70bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613796736:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 123us (1097us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191379.296974:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2298
00010000:00010000:0.0:1776191379.455268:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191380.474232:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191380.730403:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003bea0498 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630906624:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191380.730483:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191380.730586:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630906624
00000100:00100000:1.0:1776191380.730636:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3153
00000100:00100000:1.0:1776191380.730642:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000078deb88d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630906624:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191380.730673:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191380.730725:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000078deb88d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630906624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (243us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191380.730732:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3153
00000100:00100000:3.0:1776191380.730877:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003bea0498 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630906624:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191381.498788:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191381.755736:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000054825189 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630906688:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191381.755803:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191381.755974:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630906688
00000100:00100000:2.0:1776191381.756028:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3154
00000100:00100000:2.0:1776191381.756063:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c5ac88f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630906688:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191381.756096:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191381.757108:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c5ac88f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630906688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1041us (1302us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191381.757119:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3154
00000100:00100000:3.0:1776191381.758194:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000054825189 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630906688:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191382.525852:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191382.778318:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191382.778337:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0b93c82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630906752:0@lo:13:osp-pre-0-0.0
00000100:00080000:0.0:1776191382.778447:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191382.778452:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191382.778456:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191382.778461:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3915
00000100:00080000:0.0:1776191382.778465:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1776191382.778470:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191382.778491:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000093500675 x1862467630907264/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191382.778498:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1776191382.778514:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191382.778517:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191382.778520:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191382.778523:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3915
00000100:00080000:0.0:1776191382.778526:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1776191382.778529:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003824609a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630906944:0@lo:400:kworker/u8:4.0
00000100:00080000:0.0:1776191382.778531:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191382.778545:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000000b9cbeaa x1862467630907328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191382.778575:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191382.778589:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d475367 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630907200:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191382.778598:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a6e01f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630906880:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191382.778613:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191382.778635:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:0.0:1776191382.778640:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191382.778643:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f93569a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630907008:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191382.778664:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008bacde2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630907136:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191382.778672:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191382.778692:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6387b57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630907392:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191382.778698:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191382.778724:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [2->3]
00000100:00100000:3.0:1776191382.778724:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191382.778733:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d72c3363 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630906816:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191382.778763:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191382.778778:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630907200
00000100:00100000:0.0:1776191382.778783:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000075f8236 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630907072:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191382.778808:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191382.778822:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7a43fc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630907456:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191382.778824:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630907136
00000100:00100000:0.0:1776191382.778845:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191382.778850:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2012
00000100:00100000:3.0:1776191382.778857:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4fb1a2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630907200:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191382.778882:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2013
00000100:00100000:0.0:1776191382.778889:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004270d9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630907136:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191382.778910:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4fb1a2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630907200:12345-0@lo:400:kworker/u8:4.0 Request processed in 52us (297us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191382.778918:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2012
00000100:00100000:3.0:1776191382.778940:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093500675 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630907264:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191382.778963:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191382.778976:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000b9cbeaa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630907328:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191382.778994:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191382.779056:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630906880
00000100:00100000:3.0:1776191382.779066:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630907264
00000100:00100000:1.0:1776191382.779085:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630907008
00000100:00100000:3.0:1776191382.779091:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630907328
00000100:00100000:3.0:1776191382.779106:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2299
00000100:00100000:3.0:1776191382.779110:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009189961c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630907264:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191382.779114:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630907392
00000100:00100000:1.0:1776191382.779135:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630907456
00000100:00100000:1.0:1776191382.779149:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4632
00000100:00100000:1.0:1776191382.779153:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002418d9f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630906880:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191382.779188:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002418d9f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630906880:12345-0@lo:400:kworker/u8:4.0 Request processed in 34us (551us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191382.779194:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4632
00000100:00100000:1.0:1776191382.779208:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4633
00000100:00100000:1.0:1776191382.779211:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008cc360bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630907008:12345-0@lo:400:kworker/u8:4.0
00010000:02020000:3.0:1776191382.779219:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191382.779259:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008cc360bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630907008:12345-0@lo:400:kworker/u8:4.0 Request processed in 46us (587us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191382.779265:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4633
00000100:00100000:3.0:1776191382.779278:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009189961c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630907264:12345-0@lo:8:kworker/u8:4.0 Request processed in 165us (312us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191382.779284:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4634
00000100:00100000:3.0:1776191382.779288:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2299
00000100:00100000:1.0:1776191382.779292:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000808245d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630907392:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191382.779306:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2300
00000100:00100000:3.0:1776191382.779311:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003b6ef48d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630907328:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191382.779324:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000808245d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630907392:12345-0@lo:400:kworker/u8:4.0 Request processed in 33us (601us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191382.779331:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4634
00000100:00100000:1.0:1776191382.779344:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4635
00000100:00100000:1.0:1776191382.779347:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ce1e2ca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630907456:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191382.779372:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ce1e2ca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630907456:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (528us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191382.779377:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4635
00010000:02020000:3.0:1776191382.779394:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191382.779400:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1776191382.779410:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ca51694 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630907520:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191382.779422:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003b6ef48d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630907328:12345-0@lo:8:kworker/u8:4.0 Request processed in 109us (426us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191382.779428:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2300
00000100:00100000:1.0:1776191382.779445:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1776191382.779462:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191382.779467:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191382.779472:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093500675 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630907264:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191382.779483:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630906752
00000100:00080000:3.0:1776191382.779486:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191382.779490:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191382.779494:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000b9cbeaa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630907328:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191382.779512:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630907520
00000100:00100000:3.0:1776191382.779527:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1591
00000100:00100000:1.0:1776191382.779537:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1592
00000100:00100000:3.0:1776191382.779537:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005112615a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630906752:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191382.779547:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ed42626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630907520:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191382.779562:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00002000:00000024:1.0:1776191382.779564:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191382.779604:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005112615a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630906752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (1110us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191382.779615:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ed42626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630907520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (168us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191382.779615:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1591
00000100:00100000:1.0:1776191382.779625:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1592
00000100:00100000:3.0:1776191382.779658:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f93569a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630907008:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191382.779674:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ca51694 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630907520:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191382.779675:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6387b57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630907392:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191382.779693:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d475367 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630907200:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191382.779710:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0b93c82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630906752:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191382.779711:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630906944
00000100:00100000:1.0:1776191382.779738:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630907072
00000100:00100000:1.0:1776191382.779751:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3155
00000100:00100000:1.0:1776191382.779755:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003462e3ec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630906944:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191382.779774:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630906816
00000100:00100000:1.0:1776191382.779796:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003462e3ec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630906944:12345-0@lo:400:kworker/u8:4.0 Request processed in 40us (1223us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191382.779803:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1742
00000100:00100000:1.0:1776191382.779806:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3155
00000100:00100000:3.0:1776191382.779809:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb953a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630906816:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191382.779825:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3156
00000100:00100000:1.0:1776191382.779831:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081c04e2a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630907072:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191382.779844:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb953a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630906816:12345-0@lo:400:kworker/u8:4.0 Request processed in 35us (1081us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191382.779851:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1742
00000100:00100000:1.0:1776191382.779869:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081c04e2a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630907072:12345-0@lo:400:kworker/u8:4.0 Request processed in 37us (1060us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191382.779876:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3156
00000100:00100000:3.0:1776191382.779894:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d72c3363 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630906816:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191382.780386:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003824609a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630906944:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191382.782380:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000075f8236 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630907072:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191382.782401:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7a43fc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630907456:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191382.782413:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a6e01f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630906880:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191382.785951:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004270d9b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630907136:12345-0@lo:400:kworker/u8:4.0 Request processed in 7007us (7201us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191382.785967:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2013
00000100:00100000:3.0:1776191382.786184:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008bacde2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630907136:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191383.546283:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191384.410156:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191384.410210:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191384.410234:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191384.410288:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191384.410336:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613796992
00000100:00100000:0.0:1776191384.410378:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2014
00000100:00100000:0.0:1776191384.410385:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008eb36e2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613796992:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191384.410462:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008eb36e2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613796992:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 76us (174us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191384.410469:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2014
00000100:00100000:3.0:1776191384.410692:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613796928
00000100:00100000:3.0:1776191384.410726:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613796864
00000100:00100000:3.0:1776191384.410745:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4636
00000100:00100000:3.0:1776191384.410748:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000025b75de1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613796928:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191384.410777:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000025b75de1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613796928:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 28us (567us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191384.410783:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4636
00000100:00100000:3.0:1776191384.410795:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4637
00000100:00100000:3.0:1776191384.410800:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000939496a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613796864:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191384.410823:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000939496a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613796864:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 23us (589us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191384.410829:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4637
00000100:00100000:2.0:1776191384.411754:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613796800
00000100:00100000:2.0:1776191384.411800:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1743
00000100:00100000:2.0:1776191384.411806:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a5cfa2a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613796800:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191384.411858:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a5cfa2a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613796800:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 52us (1709us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191384.411865:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1743
00000100:00100000:1.0:1776191384.412125:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191384.412221:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613797056
00000100:00100000:2.0:1776191384.412262:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2301
00000100:00100000:2.0:1776191384.412343:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ca51694 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613797056:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:2.0:1776191384.412445:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191384.412535:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ca51694 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613797056:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 267us (412us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191384.412541:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2301
00010000:00010000:3.0:1776191384.571689:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191385.594429:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191385.850361:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191385.850379:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e30dc2ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630907584:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191385.850446:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191385.850766:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630907584
00000100:00100000:2.0:1776191385.850817:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3157
00000100:00100000:2.0:1776191385.850823:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008058b273 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630907584:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191385.850855:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191385.850929:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008058b273 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630907584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (476us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191385.850937:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3157
00000100:00100000:1.0:1776191385.851065:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e30dc2ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630907584:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191386.618506:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191386.875872:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191386.875897:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f7f1f93 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630907648:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191386.875967:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191386.876054:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630907648
00000100:00100000:1.0:1776191386.876108:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3158
00000100:00100000:1.0:1776191386.876113:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a26e20f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630907648:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191386.876164:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191386.876350:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a26e20f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630907648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 234us (383us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191386.876358:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3158
00000100:00100000:3.0:1776191386.876632:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f7f1f93 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630907648:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191387.642736:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191387.898342:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a6e01f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630907904:0@lo:400:kworker/u8:2.0
00000100:00080000:0.0:1776191387.898353:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191387.898359:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191387.898362:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191387.898379:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3920
00000100:00080000:0.0:1776191387.898383:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1776191387.898389:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191387.898412:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000006d475367 x1862467630908224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191387.898413:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1776191387.898433:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191387.898437:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191387.898438:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191387.898441:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3920
00000100:00080000:0.0:1776191387.898443:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1776191387.898446:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191387.898451:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003824609a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630908160:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191387.898458:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000d6387b57 x1862467630908288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191387.898478:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191387.898496:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:1.0:1776191387.898502:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008bacde2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630907840:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191387.898522:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d475367 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630908224:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191387.898528:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191387.898559:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d72c3363 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630908096:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191387.898563:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191387.898586:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6387b57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630908288:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191387.898590:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191387.898627:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630907840
00000100:00100000:1.0:1776191387.898642:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630908160
00000100:00100000:1.0:1776191387.898675:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630908224
00000100:00100000:0.0:1776191387.898677:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4638
00000100:00100000:0.0:1776191387.898684:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cec144c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630907840:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191387.898689:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630908096
00000100:00100000:1.0:1776191387.898706:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2015
00000100:00100000:1.0:1776191387.898710:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b5928219 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630908160:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191387.898740:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cec144c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630907840:12345-0@lo:400:kworker/u8:2.0 Request processed in 55us (213us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191387.898751:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4638
00000100:00100000:1.0:1776191387.898752:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b5928219 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630908160:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (274us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191387.898761:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2015
00000100:00100000:1.0:1776191387.898777:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2016
00000100:00100000:1.0:1776191387.898781:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000911fdeb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630908096:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191387.898797:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191387.898815:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000911fdeb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630908096:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (228us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191387.898822:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2016
00000100:00100000:1.0:1776191387.898834:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630908288
00000100:00100000:0.0:1776191387.898843:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2302
00000100:00100000:0.0:1776191387.898849:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093500675 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630908224:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191387.898891:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f7f1f93 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630907712:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191387.898932:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191387.898947:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7a43fc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630907968:0@lo:400:kworker/u8:2.0
00010000:02020000:0.0:1776191387.898951:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191387.898972:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191387.898992:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f93569a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630908352:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191387.899004:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093500675 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630908224:12345-0@lo:8:kworker/u8:2.0 Request processed in 152us (444us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191387.899016:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191387.899052:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [3->2]
00000100:00100000:2.0:1776191387.899058:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b397ad6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630907776:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191387.899082:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191387.899094:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000075f8236 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630908032:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191387.899111:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191387.899135:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000b9cbeaa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630908416:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191387.899154:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191387.899191:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630907904
00000100:00100000:2.0:1776191387.899208:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630908032
00000100:00100000:2.0:1776191387.899219:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3159
00000100:00100000:2.0:1776191387.899223:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000054825189 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630907904:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191387.899250:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000054825189 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630907904:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (842us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191387.899256:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3159
00000100:00100000:2.0:1776191387.899269:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3160
00000100:00100000:2.0:1776191387.899272:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009501226 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630908032:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191387.899299:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009501226 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630908032:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (188us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191387.899304:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3160
00000100:00100000:2.0:1776191387.899332:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000075f8236 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630908032:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191387.899365:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630907968
00000100:00100000:2.0:1776191387.899385:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630908352
00000100:00100000:2.0:1776191387.899397:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630908416
00000100:00100000:2.0:1776191387.899412:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4639
00000100:00100000:2.0:1776191387.899415:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b93c82 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630907968:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191387.899442:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b93c82 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630907968:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (471us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191387.899447:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4639
00000100:00100000:2.0:1776191387.899456:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4640
00000100:00100000:2.0:1776191387.899459:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003bea0498 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630908352:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191387.899476:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003bea0498 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630908352:12345-0@lo:400:kworker/u8:2.0 Request processed in 17us (462us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191387.899481:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4640
00000100:00100000:2.0:1776191387.899489:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4641
00000100:00100000:2.0:1776191387.899492:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003239335f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630908416:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191387.899510:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003239335f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630908416:12345-0@lo:400:kworker/u8:2.0 Request processed in 18us (356us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191387.899515:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4641
00000100:00080000:2.0:1776191387.899536:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191387.899540:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191387.899543:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d475367 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630908224:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191387.899562:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000b9cbeaa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630908416:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191387.899570:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7a43fc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630907968:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191387.899576:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f93569a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630908352:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191387.899616:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008bacde2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630907840:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191387.899624:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d72c3363 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630908096:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191387.899632:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003824609a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630908160:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191387.899640:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a6e01f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630907904:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191387.899860:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630907712
00000100:00100000:3.0:1776191387.899890:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1593
00000100:00100000:3.0:1776191387.899895:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e30dc2ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630907712:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191387.899921:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191387.899965:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e30dc2ee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630907712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (1032us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191387.899972:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1593
00000100:00100000:3.0:1776191387.899993:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630907776
00000100:00100000:3.0:1776191387.900020:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1744
00000100:00100000:3.0:1776191387.900028:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c7de7df8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630907776:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191387.900071:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c7de7df8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630907776:12345-0@lo:400:kworker/u8:2.0 Request processed in 43us (988us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191387.900077:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1744
00000100:00100000:3.0:1776191387.900143:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b397ad6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630907776:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191387.900162:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191387.900164:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f7f1f93 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630907712:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191387.900173:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000118d0482 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630908480:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191387.900203:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191387.900293:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2303
00000100:00100000:1.0:1776191387.900297:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000068cadb2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630908288:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191387.900369:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630908480
00010000:02020000:1.0:1776191387.900388:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191387.900391:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1594
00000100:00100000:3.0:1776191387.900396:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000cc4c333 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630908480:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191387.900408:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00080000:2.0:1776191387.900488:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191387.900492:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191387.900495:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6387b57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630908288:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191387.900908:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000068cadb2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630908288:12345-0@lo:8:kworker/u8:2.0 Request processed in 609us (2112us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191387.901001:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2303
00000100:00100000:0.0:1776191387.901888:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2302
00000100:00100000:3.0:1776191387.904135:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000cc4c333 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630908480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3729us (3923us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191387.904151:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1594
00000100:00100000:2.0:1776191387.908422:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000118d0482 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630908480:0@lo:13:osp-pre-0-0.0
00010000:00010000:0.0:1776191388.666774:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191389.533127:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191389.533220:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613797120
00000100:00100000:2.0:1776191389.533270:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1745
00000100:00100000:2.0:1776191389.533276:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000071188990 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613797120:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191389.533347:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071188990 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613797120:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 70us (227us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191389.533355:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1745
00000100:00100000:3.0:1776191389.536793:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191389.536844:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191389.536879:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191389.536962:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613797312
00000100:00100000:1.0:1776191389.537020:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2017
00000100:00100000:1.0:1776191389.537066:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f7c58b5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613797312:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191389.537139:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191389.537152:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f7c58b5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613797312:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 86us (307us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191389.537160:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2017
00000100:00100000:1.0:1776191389.537182:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613797376
00000100:00100000:1.0:1776191389.537202:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2304
00000100:00100000:1.0:1776191389.537207:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003e233a3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613797376:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:1.0:1776191389.537295:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191389.537334:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003e233a3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613797376:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 127us (197us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191389.537340:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2304
00000100:00100000:0.0:1776191389.537431:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613797184
00000100:00100000:0.0:1776191389.537466:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613797248
00000100:00100000:0.0:1776191389.537485:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4642
00000100:00100000:0.0:1776191389.537489:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f7f1f93 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613797184:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191389.537517:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f7f1f93 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613797184:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 28us (732us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191389.537522:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4642
00000100:00100000:0.0:1776191389.537533:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4643
00000100:00100000:0.0:1776191389.537536:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d9b79312 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613797248:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191389.537555:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d9b79312 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613797248:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 18us (677us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191389.537561:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4643
00010000:00010000:3.0:1776191389.691119:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191390.714543:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191390.970605:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191390.970623:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000118d0482 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630908544:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191390.970695:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191390.970798:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630908544
00000100:00100000:2.0:1776191390.970851:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3161
00000100:00100000:2.0:1776191390.970856:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdd224e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630908544:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191390.970887:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191390.970932:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdd224e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630908544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (239us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191390.970938:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3161
00000100:00100000:3.0:1776191390.971076:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000118d0482 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630908544:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191391.738364:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191391.994466:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba296d84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630908608:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191391.994542:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191391.994643:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630908608
00000100:00100000:1.0:1776191391.994691:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3162
00000100:00100000:1.0:1776191391.994698:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000035a1136 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630908608:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191391.994733:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191391.994786:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000035a1136 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630908608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (245us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191391.994793:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3162
00000100:00100000:3.0:1776191391.994966:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba296d84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630908608:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191392.762455:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1776191393.018213:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191393.018219:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191393.018222:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191393.018230:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3925
00000100:00080000:1.0:1776191393.018233:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1776191393.018239:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191393.018258:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000001d7d2914 x1862467630909120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191393.018259:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000226faff2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630908672:0@lo:400:kworker/u8:4.0
00000100:00080000:1.0:1776191393.018290:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191393.018293:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191393.018294:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191393.018297:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3925
00000100:00080000:1.0:1776191393.018298:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1776191393.018301:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191393.018310:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000a96a54e5 x1862467630909184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191393.018326:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191393.018347:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000241a0ec2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630908928:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191393.018348:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f17e505c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630908800:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191393.018369:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191393.018385:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191393.018390:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ecd900ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630909312:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191393.018399:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a86d26af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630909056:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191393.018411:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191393.018418:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191393.018423:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:0.0:1776191393.018427:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fc019f4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630908864:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191393.018430:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:1.0:1776191393.018434:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba296d84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630908736:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191393.018445:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191393.018462:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630908928
00000100:00100000:0.0:1776191393.018474:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d55fd4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630909248:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191393.018493:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630908800
00000100:00100000:0.0:1776191393.018503:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191393.018505:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3163
00000100:00100000:1.0:1776191393.018510:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e802cd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630908928:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191393.018533:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630909312
00000100:00100000:0.0:1776191393.018557:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630908864
00000100:00100000:0.0:1776191393.018569:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630909248
00000100:00100000:0.0:1776191393.018583:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4644
00000100:00100000:0.0:1776191393.018587:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000034188749 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630909312:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191393.018625:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000034188749 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630909312:12345-0@lo:400:kworker/u8:4.0 Request processed in 37us (213us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191393.018632:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4644
00000100:00100000:0.0:1776191393.018650:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4645
00000100:00100000:0.0:1776191393.018666:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009e6b98ed pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630908864:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191393.018672:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005302a7ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630909376:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191393.018707:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009e6b98ed pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630908864:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (252us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191393.018714:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191393.018719:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4645
00000100:00100000:0.0:1776191393.018736:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4646
00000100:00100000:0.0:1776191393.018740:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ab47d572 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630909248:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191393.018753:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630908672
00000100:00100000:0.0:1776191393.018777:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ab47d572 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630909248:12345-0@lo:400:kworker/u8:4.0 Request processed in 36us (283us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191393.018786:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4646
00000100:00100000:1.0:1776191393.018796:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e802cd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630908928:12345-0@lo:400:kworker/u8:4.0 Request processed in 284us (425us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191393.018798:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1746
00000100:00100000:3.0:1776191393.018806:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c42de81a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630908672:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191393.018809:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3163
00000100:00100000:1.0:1776191393.018826:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3164
00000100:00100000:1.0:1776191393.018831:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003af595e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630908800:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191393.018842:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c42de81a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630908672:12345-0@lo:400:kworker/u8:4.0 Request processed in 35us (515us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191393.018849:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1746
00000100:00100000:1.0:1776191393.018867:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003af595e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630908800:12345-0@lo:400:kworker/u8:4.0 Request processed in 35us (481us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191393.018873:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3164
00000100:00100000:1.0:1776191393.018900:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630909056
00000100:00100000:3.0:1776191393.018919:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630909376
00000100:00100000:1.0:1776191393.018927:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2018
00000100:00100000:1.0:1776191393.018932:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b92c4097 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3364:x1862467630909056:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191393.018946:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1595
00000100:00100000:3.0:1776191393.018952:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003401e3e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3363:x1862467630909376:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191393.018964:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b92c4097 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3364:x1862467630909056:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (545us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191393.018972:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2018
00002000:00000024:3.0:1776191393.018975:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191393.018978:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001d7d2914 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630909120:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191393.019026:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003401e3e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630909376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (315us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191393.019050:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191393.019056:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1595
00000100:00100000:2.0:1776191393.019077:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a96a54e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630909184:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191393.019098:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005302a7ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630909376:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191393.019106:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191393.019118:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191393.019125:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000022e4ce5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630909440:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191393.019151:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191393.019161:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630909120
00000100:00100000:3.0:1776191393.019180:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630909440
00000100:00100000:2.0:1776191393.019185:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630909184
00000100:00100000:3.0:1776191393.019210:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1596
00000100:00100000:2.0:1776191393.019214:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2305
00000100:00100000:3.0:1776191393.019218:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005302a7ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630909440:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191393.019222:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000118d0482 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630909120:12345-0@lo:8:kworker/u8:4.0
00002000:00000024:3.0:1776191393.019232:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191393.019260:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005302a7ca pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630909440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (111us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191393.019266:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1596
00000100:00100000:3.0:1776191393.019282:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2306
00000100:00100000:3.0:1776191393.019285:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d6387b57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630909184:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191393.019342:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191393.019377:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000118d0482 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630909120:12345-0@lo:8:kworker/u8:4.0 Request processed in 157us (347us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191393.019383:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2305
00010000:02020000:3.0:1776191393.019407:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1776191393.019412:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191393.019416:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191393.019421:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001d7d2914 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630909120:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191393.019439:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d6387b57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630909184:12345-0@lo:8:kworker/u8:4.0 Request processed in 151us (337us total) trans 0 rc -19/-19
00000100:00080000:2.0:1776191393.019441:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191393.019446:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191393.019449:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2306
00000100:00100000:2.0:1776191393.019451:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a96a54e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630909184:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191393.019518:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc019f4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630908864:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191393.019529:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d55fd4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630909248:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191393.019538:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ecd900ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630909312:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191393.019545:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000226faff2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630908672:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191393.019552:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000241a0ec2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630908928:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191393.020165:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000022e4ce5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630909440:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191393.020242:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191393.020270:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000a8a89e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630908992:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191393.020298:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191393.020325:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f17e505c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630908800:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191393.020333:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a86d26af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630909056:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191393.020396:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630908736
00000100:00100000:0.0:1776191393.020428:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4647
00000100:00100000:0.0:1776191393.020432:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b2914ae0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630908736:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191393.020605:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630908992
00000100:00100000:3.0:1776191393.020639:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2019
00000100:00100000:3.0:1776191393.020644:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f5a166e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630908992:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191393.020754:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b2914ae0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630908736:12345-0@lo:400:kworker/u8:4.0 Request processed in 321us (513us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191393.021282:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba296d84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630908736:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191393.021350:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4647
00000100:00100000:3.0:1776191393.021441:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f5a166e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630908992:12345-0@lo:400:kworker/u8:4.0 Request processed in 795us (1142us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191393.021448:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2019
00000100:00100000:1.0:1776191393.022244:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000a8a89e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630908992:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191393.786759:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191394.651823:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191394.651927:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191394.651960:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191394.652003:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191394.652077:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613797632
00000100:00100000:1.0:1776191394.652264:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2020
00000100:00100000:1.0:1776191394.652270:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f17e505c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613797632:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191394.652336:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f17e505c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613797632:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 65us (333us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191394.652344:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2020
00000100:00100000:3.0:1776191394.653136:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613797504
00000100:00100000:3.0:1776191394.653172:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613797568
00000100:00100000:3.0:1776191394.653200:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4648
00000100:00100000:3.0:1776191394.653205:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000a8a89e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613797504:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191394.653250:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000a8a89e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613797504:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 44us (1324us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191394.653256:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4648
00000100:00100000:3.0:1776191394.653269:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4649
00000100:00100000:3.0:1776191394.653272:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a86d26af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613797568:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191394.653295:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a86d26af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613797568:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 22us (1336us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191394.653301:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4649
00000100:00100000:3.0:1776191394.653393:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191394.653475:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613797696
00000100:00100000:3.0:1776191394.653493:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2307
00000100:00100000:3.0:1776191394.653497:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000057cc3d6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613797696:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:3.0:1776191394.653590:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191394.653618:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000057cc3d6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613797696:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 119us (226us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191394.653627:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2307
00000100:00100000:2.0:1776191394.657825:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613797440
00000100:00100000:2.0:1776191394.658266:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1747
00000100:00100000:2.0:1776191394.658276:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc7ff80b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613797440:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191394.658555:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc7ff80b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613797440:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 279us (6741us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191394.658564:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1747
00010000:00010000:3.0:1776191394.812811:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191395.834318:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191396.090953:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1776191396.090975:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b397ad6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630909504:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191396.091074:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191396.091135:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630909504
00000100:00100000:1.0:1776191396.091188:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3165
00000100:00100000:1.0:1776191396.091194:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007959640e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630909504:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191396.091226:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191396.091356:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007959640e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630909504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 160us (282us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191396.091363:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3165
00000100:00100000:3.0:1776191396.091840:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b397ad6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630909504:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191396.859015:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191397.115061:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004831c73f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630909568:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191397.115143:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191397.115269:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630909568
00000100:00100000:1.0:1776191397.115332:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3166
00000100:00100000:1.0:1776191397.115338:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b8ca4c1a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630909568:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191397.115369:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191397.115439:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b8ca4c1a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630909568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (296us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191397.115445:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3166
00000100:00100000:3.0:1776191397.115498:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004831c73f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630909568:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191397.884604:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1776191398.138319:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191398.138326:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191398.138329:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191398.138337:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3931
00000100:00080000:1.0:1776191398.138340:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1776191398.138346:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191398.138631:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003f4bfd6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630909824:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191398.138691:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191398.138716:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048e1f2c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630909760:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191398.138723:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e56d17f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630910144:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191398.138766:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191398.138766:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191398.138794:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000241a0ec2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630910016:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191398.138821:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191398.138861:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630909760
00000100:00100000:0.0:1776191398.138910:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3167
00000100:00100000:0.0:1776191398.138916:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004be80615 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630909760:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191398.138964:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004be80615 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630909760:12345-0@lo:400:kworker/u8:4.0 Request processed in 47us (203us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191398.138971:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3167
00000100:00100000:0.0:1776191398.138995:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630910016
00000100:00100000:0.0:1776191398.139018:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2021
00000100:00100000:0.0:1776191398.139022:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d015842b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630910016:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191398.139066:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d015842b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630910016:12345-0@lo:400:kworker/u8:4.0 Request processed in 43us (245us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191398.139071:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2021
00000100:00100000:0.0:1776191398.139105:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048e1f2c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630909760:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191398.139115:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000241a0ec2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630910016:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191398.139137:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0fd09fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630909632:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191398.139163:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191398.139176:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003af595e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630909888:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191398.139191:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191398.139204:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:0.0:1776191398.139209:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ccb6319 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630909696:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191398.139225:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191398.139237:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004831c73f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630909952:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191398.139265:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191398.139284:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630909888
00000100:00100000:0.0:1776191398.139301:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3168
00000100:00100000:0.0:1776191398.139304:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000088f7423f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630909888:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191398.139333:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000088f7423f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630909888:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (142us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191398.139339:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3168
00000100:00100000:0.0:1776191398.139355:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630909952
00000100:00100000:1.0:1776191398.139514:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000ecd900ea x1862467630910080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191398.139533:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191398.139537:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191398.139539:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191398.139542:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3931
00000100:00080000:1.0:1776191398.139543:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1776191398.139784:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191398.139806:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000007d55fd4e x1862467630910208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191398.139846:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a96a54e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630910336:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191398.139877:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191398.139911:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191398.139917:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fc019f4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630910272:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191398.139940:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191398.139949:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2022
00000100:00100000:0.0:1776191398.139955:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e89c7adb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630909952:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191398.139975:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630909824
00000100:00100000:0.0:1776191398.139992:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e89c7adb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630909952:12345-0@lo:400:kworker/u8:4.0 Request processed in 36us (726us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191398.139998:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2022
00000100:00100000:1.0:1776191398.140018:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630909696
00000100:00100000:0.0:1776191398.140054:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004831c73f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630909952:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191398.140065:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003af595e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630909888:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191398.140100:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630910336
00000100:00100000:0.0:1776191398.140122:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630910272
00000100:00100000:0.0:1776191398.140132:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4650
00000100:00100000:0.0:1776191398.140136:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008f5177a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630909824:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191398.140171:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008f5177a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630909824:12345-0@lo:400:kworker/u8:4.0 Request processed in 33us (1481us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191398.140177:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4650
00000100:00100000:0.0:1776191398.140189:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4651
00000100:00100000:0.0:1776191398.140192:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001ee0e786 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630909696:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191398.140224:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001ee0e786 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630909696:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (998us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191398.140228:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4651
00000100:00100000:0.0:1776191398.140239:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4652
00000100:00100000:0.0:1776191398.140242:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001d7d2914 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630910336:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191398.140266:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001d7d2914 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630910336:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (390us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191398.140271:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4652
00000100:00100000:0.0:1776191398.140281:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4653
00000100:00100000:0.0:1776191398.140285:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000241a0ec2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630910272:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191398.140306:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000241a0ec2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630910272:12345-0@lo:400:kworker/u8:4.0 Request processed in 21us (368us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191398.140311:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4653
00000100:00100000:0.0:1776191398.140336:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003f4bfd6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630909824:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191398.140358:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ccb6319 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630909696:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191398.140573:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ecd900ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630910080:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191398.140605:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191398.140619:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d55fd4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630910208:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191398.140637:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191398.140661:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630910080
00000100:00100000:2.0:1776191398.140680:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630910208
00000100:00100000:2.0:1776191398.140692:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2308
00000100:00100000:2.0:1776191398.140696:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a6e01f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630910080:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191398.140787:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191398.140823:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a6e01f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630910080:12345-0@lo:8:kworker/u8:4.0 Request processed in 125us (218us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191398.140830:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2308
00000100:00100000:2.0:1776191398.140844:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2309
00000100:00100000:2.0:1776191398.140848:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003824609a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630910208:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191398.140876:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630910144
00010000:02020000:2.0:1776191398.140943:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191398.140966:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003824609a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630910208:12345-0@lo:8:kworker/u8:4.0 Request processed in 117us (329us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191398.140972:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2309
00000100:00100000:1.0:1776191398.141011:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630909632
00000100:00100000:0.0:1776191398.141124:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc019f4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630910272:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191398.141134:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a96a54e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630910336:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191398.141157:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089abc1e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630910400:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191398.141189:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191398.141189:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1597
00000100:00100000:3.0:1776191398.141197:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef3b35f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630910144:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191398.141237:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630910400
00000100:00100000:0.0:1776191398.141259:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1598
00000100:00100000:0.0:1776191398.141263:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000341b9800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630910400:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191398.141288:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00002000:00000024:3.0:1776191398.141289:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191398.141343:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef3b35f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630910144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 145us (2580us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191398.141347:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000341b9800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630910400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (159us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191398.141356:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1597
00000100:00100000:1.0:1776191398.141580:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1748
00000100:00100000:1.0:1776191398.141584:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bcb4f46f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630909632:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191398.141634:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bcb4f46f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630909632:12345-0@lo:400:kworker/u8:4.0 Request processed in 49us (2470us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191398.141639:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1598
00000100:00100000:1.0:1776191398.141645:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1748
00000100:00100000:0.0:1776191398.141688:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e56d17f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630910144:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191398.141697:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0fd09fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630909632:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191398.141724:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089abc1e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630910400:0@lo:13:osp-pre-0-0.0
00000100:00080000:2.0:1776191398.142249:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191398.142253:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191398.142258:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ecd900ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630910080:0@lo:8:kworker/u8:4.0
00000100:00080000:2.0:1776191398.142267:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191398.142269:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191398.142271:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d55fd4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630910208:0@lo:8:kworker/u8:4.0
00010000:00010000:3.0:1776191398.906406:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191399.771793:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191399.771837:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191399.771897:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191399.771981:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191399.771982:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613798016
00000100:00100000:3.0:1776191399.772027:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2310
00000100:00100000:1.0:1776191399.772077:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191399.772113:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613797888
00000100:00100000:1.0:1776191399.772142:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613797824
00000100:00100000:1.0:1776191399.772158:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4654
00000100:00100000:1.0:1776191399.772164:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048e1f2c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613797888:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191399.772229:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048e1f2c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613797888:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 65us (332us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191399.772237:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4654
00000100:00100000:1.0:1776191399.772263:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4655
00000100:00100000:1.0:1776191399.772267:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d55fd4e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613797824:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191399.772286:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d55fd4e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613797824:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 19us (307us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191399.772291:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4655
00000100:00100000:2.0:1776191399.772738:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613797760
00000100:00100000:2.0:1776191399.772777:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1749
00000100:00100000:2.0:1776191399.772782:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ac96f048 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613797760:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191399.772830:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ac96f048 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613797760:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 47us (993us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191399.772838:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1749
00000100:00100000:2.0:1776191399.772880:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613797952
00000100:00100000:3.0:1776191399.772939:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0fd09fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613798016:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:3.0:1776191399.773049:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191399.773096:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0fd09fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613798016:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 158us (1311us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191399.776728:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2023
00000100:00100000:2.0:1776191399.776740:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ecd900ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613797952:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191399.776833:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ecd900ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613797952:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 94us (4756us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191399.776840:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2023
00000100:00100000:3.0:1776191399.779334:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2310
00010000:00010000:3.0:1776191399.931107:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191400.954641:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191401.210463:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d72c3363 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630910464:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191401.210530:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191401.210710:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630910464
00000100:00100000:2.0:1776191401.210761:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3169
00000100:00100000:2.0:1776191401.210768:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008831914d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630910464:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191401.210806:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191401.210873:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008831914d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630910464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (343us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191401.210880:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3169
00000100:00100000:3.0:1776191401.211063:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d72c3363 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630910464:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191401.978366:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191402.234556:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a96a54e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630910528:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191402.234636:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191402.234866:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630910528
00000100:00100000:1.0:1776191402.234910:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3170
00000100:00100000:1.0:1776191402.234916:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008bacde2f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630910528:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191402.234949:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191402.234998:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008bacde2f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630910528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (363us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191402.235004:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3170
00000100:00100000:3.0:1776191402.235097:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a96a54e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630910528:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191403.003391:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1776191403.258302:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191403.258310:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191403.258313:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191403.258321:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3936
00000100:00080000:3.0:1776191403.258324:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1776191403.258329:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191403.258361:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000e56d17f1 x1862467630911040/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191403.258376:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191403.258379:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191403.258380:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191403.258383:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3936
00000100:00080000:3.0:1776191403.258385:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1776191403.258388:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191403.258397:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000bfdd224e x1862467630911104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191403.258445:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ce45b6e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630910656:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191403.258500:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191403.258541:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000242c8400 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630910912:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191403.258564:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191403.258582:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:3.0:1776191403.258587:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f00cec27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630910720:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191403.258608:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191403.258620:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089abc1e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630910976:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191403.258639:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191403.258669:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630910656
00000100:00100000:3.0:1776191403.258708:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4656
00000100:00100000:3.0:1776191403.258713:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f6b2ee02 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630910656:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191403.258759:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f6b2ee02 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630910656:12345-0@lo:400:kworker/u8:2.0 Request processed in 45us (260us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191403.258773:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4656
00000100:00100000:3.0:1776191403.258825:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ce45b6e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630910656:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191403.258857:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630910912
00000100:00100000:3.0:1776191403.258883:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630910976
00000100:00100000:3.0:1776191403.258899:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2024
00000100:00100000:3.0:1776191403.258903:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027e578e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630910912:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191403.258937:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027e578e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630910912:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (372us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191403.258943:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2024
00000100:00100000:3.0:1776191403.258954:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2025
00000100:00100000:3.0:1776191403.258957:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002fc9e52b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630910976:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191403.258982:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002fc9e52b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630910976:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (343us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191403.258987:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2025
00000100:00100000:3.0:1776191403.259012:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089abc1e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630910976:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191403.259022:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000242c8400 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630910912:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191403.259157:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008629d0f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630910784:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191403.259187:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191403.259209:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000035a1136 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630911168:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191403.259229:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191403.259242:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [1->0]
00000100:00100000:1.0:1776191403.259247:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f5f736f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630910592:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191403.259269:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191403.259289:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000067aab686 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630910848:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191403.259308:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191403.259322:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000022e4ce5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630911232:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191403.259340:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191403.259362:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630910720
00000100:00100000:1.0:1776191403.259395:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630910848
00000100:00100000:1.0:1776191403.259409:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3171
00000100:00100000:1.0:1776191403.259413:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a3bd616 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630910720:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191403.259447:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a3bd616 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630910720:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (838us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191403.259452:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3171
00000100:00100000:1.0:1776191403.259464:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3172
00000100:00100000:1.0:1776191403.259468:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003f4bfd6c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630910848:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191403.259495:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003f4bfd6c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630910848:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (186us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191403.259501:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3172
00000100:00100000:1.0:1776191403.259518:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630910784
00000100:00100000:1.0:1776191403.259537:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630911168
00000100:00100000:1.0:1776191403.259550:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630911232
00000100:00100000:1.0:1776191403.259566:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4657
00000100:00100000:1.0:1776191403.259570:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fc019f4b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630910784:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191403.259595:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fc019f4b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630910784:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (409us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191403.259600:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4657
00000100:00100000:1.0:1776191403.259609:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4658
00000100:00100000:1.0:1776191403.259612:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ccb6319 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630911168:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191403.259629:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ccb6319 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630911168:12345-0@lo:400:kworker/u8:2.0 Request processed in 17us (400us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191403.259634:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4658
00000100:00100000:1.0:1776191403.259641:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4659
00000100:00100000:1.0:1776191403.259644:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003af595e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630911232:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191403.259661:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003af595e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630911232:12345-0@lo:400:kworker/u8:2.0 Request processed in 16us (321us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191403.259666:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4659
00000100:00100000:1.0:1776191403.259684:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630910592
00000100:00100000:1.0:1776191403.259701:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1750
00000100:00100000:1.0:1776191403.259704:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b37044fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630910592:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191403.259725:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b37044fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630910592:12345-0@lo:400:kworker/u8:2.0 Request processed in 20us (456us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191403.259730:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1750
00000100:00100000:1.0:1776191403.259770:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f5f736f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630910592:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191403.259778:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000067aab686 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630910848:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191403.259796:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000022e4ce5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630911232:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191403.259804:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008629d0f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630910784:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191403.259812:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000035a1136 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630911168:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191403.260725:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e56d17f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630911040:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191403.260772:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191403.260807:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdd224e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630911104:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191403.260824:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191403.260854:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630911040
00000100:00100000:2.0:1776191403.260873:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630911104
00000100:00100000:2.0:1776191403.260886:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2311
00000100:00100000:2.0:1776191403.260889:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f93569a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630911040:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191403.260982:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191403.261016:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f93569a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630911040:12345-0@lo:8:kworker/u8:2.0 Request processed in 126us (244us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191403.261022:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2311
00000100:00100000:2.0:1776191403.261060:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2312
00000100:00100000:2.0:1776191403.261063:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e7a43fc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630911104:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191403.261140:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191403.261166:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e7a43fc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630911104:12345-0@lo:8:kworker/u8:2.0 Request processed in 102us (341us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191403.261171:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2312
00000100:00080000:2.0:1776191403.261201:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191403.261206:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191403.261209:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e56d17f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630911040:0@lo:8:kworker/u8:2.0
00000100:00080000:2.0:1776191403.261215:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191403.261217:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191403.261219:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdd224e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630911104:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191403.261430:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c1893c50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630911296:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191403.261459:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191403.261485:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f00cec27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630910720:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191403.262029:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1776191403.262061:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004831c73f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630911360:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191403.262089:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191403.262172:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630911296
00000100:00100000:0.0:1776191403.262209:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630911360
00000100:00100000:0.0:1776191403.262228:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1599
00000100:00100000:0.0:1776191403.262232:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af172616 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630911296:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191403.262260:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191403.262298:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af172616 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630911296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (838us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191403.262305:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1599
00000100:00100000:0.0:1776191403.262318:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1600
00000100:00100000:0.0:1776191403.262321:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dab16da3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630911360:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191403.262330:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191403.262364:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dab16da3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630911360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (274us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191403.262369:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1600
00000100:00100000:0.0:1776191403.262407:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004831c73f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630911360:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191403.262418:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c1893c50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630911296:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1776191404.028172:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191404.890623:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191404.891923:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191404.891963:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191404.892000:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191404.892078:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613798272
00000100:00100000:0.0:1776191404.892125:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2026
00000100:00100000:0.0:1776191404.892132:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba296d84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613798272:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191404.892159:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613798080
00000100:00100000:2.0:1776191404.892195:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1751
00000100:00100000:2.0:1776191404.892200:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004e50600 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613798080:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191404.892212:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba296d84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613798272:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 79us (291us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191404.892221:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2026
00000100:00100000:2.0:1776191404.892233:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004e50600 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613798080:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 31us (268us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191404.892242:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1751
00000100:00100000:3.0:1776191404.897282:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191404.897540:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613798144
00000100:00100000:1.0:1776191404.898071:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613798208
00000100:00100000:0.0:1776191404.898343:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613798336
00000100:00100000:0.0:1776191404.898369:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2313
00000100:00100000:0.0:1776191404.898375:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c1893c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613798336:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:0.0:1776191404.898484:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191404.898547:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c1893c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613798336:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 171us (1271us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191404.898554:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2313
00000100:00100000:2.0:1776191404.899516:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4660
00000100:00100000:2.0:1776191404.899524:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c0278cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613798144:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191404.899590:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c0278cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613798144:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 66us (8975us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191404.899597:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4660
00000100:00100000:2.0:1776191404.899615:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4661
00000100:00100000:2.0:1776191404.899620:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000226faff2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613798208:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191404.899645:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000226faff2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613798208:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 25us (7645us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191404.899650:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4661
00010000:00010000:3.0:1776191405.053123:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191406.074297:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191406.330712:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191406.330738:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000b9cbeaa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630911424:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191406.330805:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191406.330894:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630911424
00000100:00100000:2.0:1776191406.330956:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3173
00000100:00100000:2.0:1776191406.330963:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f210a7b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630911424:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191406.330995:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191406.331068:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f210a7b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630911424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (264us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191406.331075:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3173
00000100:00100000:0.0:1776191406.331246:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000b9cbeaa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630911424:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191407.102251:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191407.357334:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004831c73f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630911488:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191407.357824:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191407.358019:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630911488
00000100:00100000:2.0:1776191407.358220:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3174
00000100:00100000:2.0:1776191407.358226:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fce6fdea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630911488:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191407.358259:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191407.358322:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fce6fdea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630911488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (503us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191407.358329:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3174
00000100:00100000:0.0:1776191407.358404:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004831c73f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630911488:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191408.122563:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191408.378205:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f00cec27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630911552:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1776191408.378235:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191408.378241:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191408.378244:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191408.378248:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3941
00000100:00080000:3.0:1776191408.378250:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1776191408.378257:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191408.378276:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191408.378276:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000242c8400 x1862467630912128/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191408.378280:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000035a1136 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630911744:0@lo:400:kworker/u8:2.0
00000100:00080000:3.0:1776191408.378297:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1776191408.378319:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191408.378339:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f5f736f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630912000:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191408.378360:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191408.378374:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdd224e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630911616:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191408.378411:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1776191408.378494:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1776191408.381868:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000022e4ce5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630911872:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191408.381934:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191408.381964:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:2.0:1776191408.381971:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008629d0f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630911808:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191408.381993:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191408.382008:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a96a54e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630912064:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191408.382029:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191408.382086:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630911744
00000100:00100000:2.0:1776191408.382115:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630911872
00000100:00100000:2.0:1776191408.382129:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3175
00000100:00100000:2.0:1776191408.382134:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004831c73f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630911744:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191408.382179:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004831c73f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630911744:12345-0@lo:400:kworker/u8:2.0 Request processed in 44us (3860us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191408.382186:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3175
00000100:00100000:2.0:1776191408.382201:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3176
00000100:00100000:2.0:1776191408.382204:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d475367 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630911872:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191408.382232:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d475367 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630911872:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (298us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191408.382238:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3176
00000100:00100000:2.0:1776191408.382254:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630911552
00000100:00100000:2.0:1776191408.382275:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630912064
00000100:00100000:2.0:1776191408.382289:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1601
00000100:00100000:2.0:1776191408.382292:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008cb50901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630911552:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191408.382327:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191408.382366:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008cb50901 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630911552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (4081us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191408.382373:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1601
00000100:00100000:2.0:1776191408.382384:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1602
00000100:00100000:2.0:1776191408.382387:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000b9cbeaa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630912064:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191408.382396:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191408.382416:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000b9cbeaa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630912064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 28us (386us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191408.382421:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1602
00000100:00100000:2.0:1776191408.382464:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a96a54e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630912064:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191408.382476:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000022e4ce5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630911872:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191408.382516:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000035a1136 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630911744:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191408.382526:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:1.0:1776191408.382531:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e56d17f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630911680:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191408.382553:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191408.382553:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000242c8400 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630912128:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191408.382585:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191408.382624:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000067aab686 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630911936:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191408.382643:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630911808
00000100:00100000:1.0:1776191408.382652:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191408.382686:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630911680
00000100:00100000:1.0:1776191408.382695:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630912000
00000100:00100000:0.0:1776191408.382710:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630912128
00000100:00100000:2.0:1776191408.382712:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4662
00000100:00100000:2.0:1776191408.382718:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000075f8236 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630911808:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191408.382736:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630911936
00000100:00100000:0.0:1776191408.382752:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2027
00000100:00100000:0.0:1776191408.382758:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001bc0bbec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630912000:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191408.382762:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000075f8236 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630911808:12345-0@lo:400:kworker/u8:2.0 Request processed in 41us (766us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191408.382771:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4662
00000100:00100000:1.0:1776191408.382780:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2028
00000100:00100000:1.0:1776191408.382786:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001ca7e4d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630911936:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191408.382791:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4663
00000100:00100000:2.0:1776191408.382798:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd82c1e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630911680:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191408.382839:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001ca7e4d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630911936:12345-0@lo:400:kworker/u8:2.0 Request processed in 53us (186us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191408.382847:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2028
00000100:00100000:1.0:1776191408.382860:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2314
00000100:00100000:1.0:1776191408.382863:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d72c3363 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630912128:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:1.0:1776191408.382974:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191408.383009:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d72c3363 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630912128:12345-0@lo:8:kworker/u8:2.0 Request processed in 144us (424us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191408.383015:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2314
00000100:00100000:1.0:1776191408.383049:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630911616
00000100:00100000:1.0:1776191408.383084:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1752
00000100:00100000:1.0:1776191408.383088:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f9005e31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630911616:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191408.383126:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f9005e31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630911616:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (4715us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191408.383133:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1752
00000100:00080000:3.0:1776191408.383610:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191408.383617:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3941
00000100:00080000:3.0:1776191408.383619:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1776191408.383623:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191408.383650:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000089abc1e6 x1862467630912192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191408.383782:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd82c1e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630911680:12345-0@lo:400:kworker/u8:2.0 Request processed in 984us (1230us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191408.383789:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e56d17f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630911680:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191408.383792:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4663
00000100:00100000:1.0:1776191408.383807:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000067aab686 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630911936:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191408.383825:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089abc1e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630912192:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191408.383853:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1776191408.384080:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191408.384084:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191408.384088:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000242c8400 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630912128:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191408.384292:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630912192
00000100:00100000:3.0:1776191408.384320:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2315
00000100:00100000:3.0:1776191408.384325:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b397ad6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630912192:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191408.384446:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001bc0bbec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630912000:12345-0@lo:400:kworker/u8:2.0 Request processed in 1687us (6085us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191408.384453:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2027
00000100:00100000:1.0:1776191408.384488:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f5f736f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630912000:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191408.384508:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191408.384514:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000035a1136 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630912320:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191408.384530:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f00cec27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630911552:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191408.384536:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191408.384545:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191408.384563:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630912320
00000100:00100000:1.0:1776191408.384578:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ce45b6e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630912256:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191408.384593:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4664
00000100:00100000:0.0:1776191408.384599:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007582ba84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630912320:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191408.384605:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191408.384648:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007582ba84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630912320:12345-0@lo:400:kworker/u8:2.0 Request processed in 49us (112us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191408.384655:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4664
00000100:00100000:0.0:1776191408.384667:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630912256
00000100:00100000:0.0:1776191408.384699:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4665
00000100:00100000:0.0:1776191408.384702:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d06252d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630912256:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191408.384738:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000035a1136 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630912320:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191408.384741:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d06252d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630912256:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (137us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191408.384749:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4665
00000100:00100000:0.0:1776191408.384781:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ce45b6e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630912256:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191408.384809:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008629d0f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630911808:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191408.384823:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdd224e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630911616:0@lo:400:kworker/u8:2.0
00010000:02020000:3.0:1776191408.384907:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191408.384961:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b397ad6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630912192:12345-0@lo:8:kworker/u8:2.0 Request processed in 635us (1107us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191408.384967:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2315
00000100:00080000:0.0:1776191408.385297:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191408.385301:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191408.385304:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089abc1e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630912192:0@lo:8:kworker/u8:2.0
00010000:00010000:3.0:1776191409.146395:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191410.010509:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191410.010553:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191410.010589:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191410.010623:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191410.010671:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613798464
00000100:00100000:2.0:1776191410.010683:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613798528
00000100:00100000:3.0:1776191410.010730:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4666
00000100:00100000:3.0:1776191410.010737:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000022e4ce5b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613798464:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191410.010784:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613798592
00000100:00100000:3.0:1776191410.010805:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000022e4ce5b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613798464:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 66us (251us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191410.010813:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4666
00000100:00100000:0.0:1776191410.010822:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2029
00000100:00100000:0.0:1776191410.010829:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdd224e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613798592:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191410.010836:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4667
00000100:00100000:3.0:1776191410.010842:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000089abc1e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613798528:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191410.010869:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdd224e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613798592:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 40us (246us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191410.010880:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2029
00000100:00100000:3.0:1776191410.011340:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000089abc1e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613798528:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 31us (285us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191410.011348:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4667
00000100:00100000:1.0:1776191410.011420:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613798400
00000100:00100000:1.0:1776191410.011449:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1753
00000100:00100000:1.0:1776191410.011454:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000961e9bab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613798400:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191410.011488:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000961e9bab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613798400:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 34us (987us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191410.011495:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1753
00000100:00100000:1.0:1776191410.015948:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191410.016076:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613798656
00000100:00100000:3.0:1776191410.016123:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2316
00000100:00100000:3.0:1776191410.016130:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096baf6e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613798656:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:3.0:1776191410.016231:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191410.016290:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096baf6e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613798656:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 159us (347us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191410.016298:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2316
00010000:00010000:3.0:1776191410.173215:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191411.194725:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191411.454138:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776191411.454172:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008e14e826 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630912384:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191411.454255:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191411.454404:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630912384
00000100:00100000:2.0:1776191411.454464:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3177
00000100:00100000:2.0:1776191411.454470:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000954c89ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630912384:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191411.454952:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191411.455013:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000954c89ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630912384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 541us (757us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191411.455021:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3177
00000100:00100000:0.0:1776191411.455132:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008e14e826 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630912384:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191412.221823:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191412.475001:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000070c80d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630912448:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191412.475087:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191412.475417:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630912448
00000100:00100000:1.0:1776191412.475514:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3178
00000100:00100000:1.0:1776191412.475522:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc840106 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630912448:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191412.475554:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191412.475615:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc840106 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630912448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (529us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191412.475622:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3178
00000100:00100000:0.0:1776191412.475691:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000070c80d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630912448:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191413.242950:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191413.499428:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1776191413.499442:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b30532d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630912512:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191413.499515:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191413.499559:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c1011c34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630912640:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191413.499581:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630912512
00000100:00100000:3.0:1776191413.499613:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191413.499631:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1754
00000100:00100000:1.0:1776191413.499639:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dce6a0d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630912512:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191413.499639:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191413.499648:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008629d0f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630912576:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191413.499677:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191413.499705:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dce6a0d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630912512:12345-0@lo:400:kworker/u8:2.0 Request processed in 65us (189us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191413.499713:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630912640
00000100:00100000:1.0:1776191413.499714:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1754
00000100:00100000:3.0:1776191413.499750:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4668
00000100:00100000:3.0:1776191413.499756:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ce45b6e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630912640:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191413.499773:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b30532d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630912512:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191413.499800:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ce45b6e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630912640:12345-0@lo:400:kworker/u8:2.0 Request processed in 43us (188us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191413.499808:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4668
00000100:00100000:1.0:1776191413.499817:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630912576
00000100:00100000:3.0:1776191413.499846:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c1011c34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630912640:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191413.499851:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1603
00000100:00100000:1.0:1776191413.499869:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000035a1136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630912576:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191413.499893:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191413.499934:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000035a1136 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630912576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (257us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191413.499941:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1603
00000100:00080000:0.0:1776191413.500019:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191413.500024:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191413.500027:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191413.500052:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3946
00000100:00080000:0.0:1776191413.500055:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1776191413.500059:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191413.500079:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000045d4856e x1862467630912960/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191413.500093:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191413.500096:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191413.500098:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191413.500101:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3946
00000100:00080000:0.0:1776191413.500102:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1776191413.500105:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191413.500116:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000028cc0665 x1862467630913024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191413.500149:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045d4856e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630912960:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191413.500166:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b30532d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630912832:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191413.500182:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191413.500207:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028cc0665 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630913024:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191413.500208:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191413.500236:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776191413.500240:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191413.500244:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008e802cd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630912896:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191413.500275:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630912960
00000100:00100000:3.0:1776191413.500287:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191413.500368:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c1011c34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630912768:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191413.500405:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191413.500425:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000059801540 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630913152:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191413.500445:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191413.500461:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:2.0:1776191413.500466:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000603b89b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630912704:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191413.500494:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191413.500508:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b6af7b47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630913088:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191413.500526:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191413.500601:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630912768
00000100:00100000:2.0:1776191413.500631:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630913152
00000100:00100000:2.0:1776191413.500647:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630913088
00000100:00100000:2.0:1776191413.500663:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4669
00000100:00100000:2.0:1776191413.500668:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001fbd73a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630912768:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191413.500705:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001fbd73a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630912768:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (300us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191413.500711:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4669
00000100:00100000:2.0:1776191413.500725:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4670
00000100:00100000:2.0:1776191413.500728:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081c04e2a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630913152:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191413.500760:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081c04e2a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630913152:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (314us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191413.500766:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4670
00000100:00100000:2.0:1776191413.500777:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4671
00000100:00100000:2.0:1776191413.500780:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e14e826 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630913088:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191413.500810:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e14e826 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630913088:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (283us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191413.500815:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4671
00000100:00100000:2.0:1776191413.500837:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630912832
00000100:00100000:2.0:1776191413.500857:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630912704
00000100:00100000:2.0:1776191413.500869:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3179
00000100:00100000:2.0:1776191413.500873:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f00cec27 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630912832:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191413.500900:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f00cec27 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630912832:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (695us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191413.500905:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3179
00000100:00100000:2.0:1776191413.500916:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3180
00000100:00100000:2.0:1776191413.500920:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008058b273 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630912704:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191413.500942:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008058b273 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630912704:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (448us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191413.500950:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3180
00000100:00100000:2.0:1776191413.500978:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000603b89b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630912704:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191413.501018:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b6af7b47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630913088:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191413.501027:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c1011c34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630912768:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191413.501057:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000059801540 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630913152:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191413.501099:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008629d0f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630912576:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191413.501110:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1776191413.501115:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a96a54e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630913216:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191413.501205:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191413.501233:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630913216
00000100:00100000:2.0:1776191413.501257:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1604
00000100:00100000:2.0:1776191413.501261:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c1011c34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630913216:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191413.501273:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191413.501303:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c1011c34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630913216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (165us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191413.501309:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1604
00000100:00100000:2.0:1776191413.501333:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a96a54e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630913216:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191413.501518:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b30532d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630912832:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191413.502492:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630912896
00000100:00100000:3.0:1776191413.502543:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2030
00000100:00100000:3.0:1776191413.502547:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f5f736f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630912896:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191413.502616:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f5f736f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630912896:12345-0@lo:400:kworker/u8:2.0 Request processed in 68us (2331us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191413.502623:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2030
00000100:00100000:3.0:1776191413.502637:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2317
00000100:00100000:3.0:1776191413.502640:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000063a7a5a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630912960:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191413.502732:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191413.502765:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000063a7a5a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630912960:12345-0@lo:8:kworker/u8:2.0 Request processed in 123us (2584us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191413.502772:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2317
00000100:00100000:3.0:1776191413.502814:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008e802cd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630912896:0@lo:400:kworker/u8:2.0
00000100:00080000:3.0:1776191413.502872:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191413.502876:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191413.502880:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045d4856e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630912960:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191413.504985:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630913024
00000100:00100000:0.0:1776191413.505060:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2318
00000100:00100000:0.0:1776191413.505066:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000813d4ddd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630913024:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191413.505167:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191413.505251:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000813d4ddd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630913024:12345-0@lo:8:kworker/u8:2.0 Request processed in 184us (5013us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191413.505258:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2318
00000100:00080000:3.0:1776191413.505504:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191413.505509:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191413.505514:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028cc0665 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630913024:0@lo:8:kworker/u8:2.0
00010000:00010000:3.0:1776191414.267837:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191415.130787:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191415.130835:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191415.130861:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191415.130900:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191415.130927:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191415.130961:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613798976
00000100:00100000:1.0:1776191415.130994:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613798912
00000100:00100000:1.0:1776191415.131021:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2031
00000100:00100000:1.0:1776191415.131028:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001bc0bbec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613798912:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191415.131134:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001bc0bbec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613798912:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 105us (273us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191415.131155:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2031
00000100:00100000:1.0:1776191415.131186:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2319
00000100:00100000:1.0:1776191415.131190:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000911fdeb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613798976:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:1.0:1776191415.131284:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191415.131316:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000911fdeb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613798976:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 125us (538us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191415.131322:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2319
00000100:00100000:2.0:1776191415.131427:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613798784
00000100:00100000:2.0:1776191415.136627:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613798848
00000100:00100000:3.0:1776191415.136906:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4672
00000100:00100000:3.0:1776191415.136915:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001ca7e4d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613798784:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191415.137014:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001ca7e4d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613798784:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 90us (6169us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191415.137023:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4672
00000100:00100000:3.0:1776191415.137066:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4673
00000100:00100000:3.0:1776191415.137070:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096baf6e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613798848:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191415.137095:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096baf6e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613798848:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 24us (6168us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191415.137101:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4673
00000100:00100000:3.0:1776191415.137258:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613798720
00000100:00100000:3.0:1776191415.137286:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1755
00000100:00100000:3.0:1776191415.137290:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd42e839 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613798720:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191415.137324:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd42e839 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613798720:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 32us (6424us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191415.137330:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1755
00010000:00010000:3.0:1776191415.290467:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191416.315717:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191416.570854:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191416.571411:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b30532d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630913280:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191416.571479:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191416.573369:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630913280
00000100:00100000:2.0:1776191416.573432:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3181
00000100:00100000:2.0:1776191416.573439:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000067aab686 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630913280:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191416.573476:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191416.573551:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000067aab686 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630913280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (2073us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191416.573559:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3181
00000100:00100000:3.0:1776191416.573606:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b30532d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630913280:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191417.338587:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191417.594588:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000070c80d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630913344:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191417.594898:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191417.595009:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630913344
00000100:00100000:3.0:1776191417.595340:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3182
00000100:00100000:3.0:1776191417.595346:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000603b89b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630913344:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191417.595378:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191417.595466:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000603b89b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630913344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (568us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191417.595473:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3182
00000100:00100000:2.0:1776191417.595562:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000070c80d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630913344:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191418.363228:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191418.618222:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b30532d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630913408:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191418.618292:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191418.618611:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630913408
00000100:00100000:3.0:1776191418.618665:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e56d17f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630913472:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191418.618666:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1605
00000100:00100000:2.0:1776191418.618671:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000063a7a5a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630913408:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191418.618693:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00002000:00000024:2.0:1776191418.618699:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191418.618724:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630913472
00000100:00100000:2.0:1776191418.618742:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000063a7a5a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630913408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (450us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191418.618744:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1606
00000100:00100000:3.0:1776191418.618747:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000242c8400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630913472:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191418.618748:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1605
00002000:00000024:3.0:1776191418.618757:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00080000:1.0:1776191418.618870:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191418.618875:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191418.618878:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191418.618882:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3951
00000100:00080000:1.0:1776191418.618884:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1776191418.618888:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191418.618905:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000016f04c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630913600:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191418.618905:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000007bb93380 x1862467630913856/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191418.618946:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b30532d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630913408:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191418.618964:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023bc758a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630913664:0@lo:400:kworker/u8:4.0
00000100:00080000:1.0:1776191418.618985:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191418.618988:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191418.618989:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191418.618992:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3951
00000100:00080000:1.0:1776191418.618994:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1776191418.618997:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191418.619009:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000048199cde x1862467630913920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191418.619069:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007bb93380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630913856:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191418.621258:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191418.621364:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000242c8400 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630913472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2613us (2669us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191418.621377:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1606
00000100:00100000:3.0:1776191418.621421:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000070c80d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630913536:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191418.621473:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191418.621492:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba29c9bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630913792:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191418.623935:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630913600
00000100:00100000:2.0:1776191418.624000:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4674
00000100:00100000:2.0:1776191418.624006:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bef615d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630913600:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191418.624081:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bef615d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630913600:12345-0@lo:400:kworker/u8:4.0 Request processed in 75us (2830us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191418.624088:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4674
00000100:00100000:1.0:1776191418.624576:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191418.624613:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048199cde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630913920:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191418.624640:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191418.624870:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000552b8f18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630913728:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191418.624883:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191418.624995:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630913856
00000100:00100000:0.0:1776191418.625021:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630913920
00000100:00100000:0.0:1776191418.625050:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2320
00000100:00100000:0.0:1776191418.625054:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d908df0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630913856:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191418.625163:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191418.625775:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191418.625910:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e56d17f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630913472:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191418.625948:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191418.625972:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000001c99791 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630914048:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191418.626015:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191418.626071:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630913728
00000100:00100000:2.0:1776191418.626109:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630914048
00000100:00100000:2.0:1776191418.626130:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4675
00000100:00100000:2.0:1776191418.626135:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b30532d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630913728:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191418.626177:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b30532d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630913728:12345-0@lo:400:kworker/u8:4.0 Request processed in 41us (407us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191418.626183:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4675
00000100:00100000:2.0:1776191418.626197:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4676
00000100:00100000:2.0:1776191418.626200:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d015842b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630914048:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191418.626241:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d015842b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630914048:12345-0@lo:400:kworker/u8:4.0 Request processed in 36us (222us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191418.626246:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4676
00000100:00100000:2.0:1776191418.626279:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000552b8f18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630913728:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191418.626305:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000001c99791 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630914048:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191418.626644:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630913792
00000100:00100000:2.0:1776191418.626668:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630913664
00000100:00100000:2.0:1776191418.626679:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3183
00000100:00100000:2.0:1776191418.626682:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f7c58b5d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630913792:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191418.627840:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f7c58b5d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630913792:12345-0@lo:400:kworker/u8:4.0 Request processed in 1151us (2952us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191418.627852:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3183
00000100:00100000:2.0:1776191418.627881:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3184
00000100:00100000:2.0:1776191418.627887:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000068cadb2f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630913664:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191418.627945:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000068cadb2f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630913664:12345-0@lo:400:kworker/u8:4.0 Request processed in 58us (1996us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191418.627950:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3184
00000100:00100000:2.0:1776191418.627976:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2321
00000100:00100000:2.0:1776191418.627980:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000365abfb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630913920:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191418.628091:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191418.628631:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000365abfb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630913920:12345-0@lo:8:kworker/u8:4.0 Request processed in 647us (3988us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191418.628639:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2321
00000100:00100000:2.0:1776191418.628707:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023bc758a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630913664:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191418.629836:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630913536
00000100:00100000:2.0:1776191418.629884:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1756
00000100:00100000:2.0:1776191418.629889:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002224990e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630913536:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191418.629953:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002224990e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630913536:12345-0@lo:400:kworker/u8:4.0 Request processed in 64us (8480us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191418.629959:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1756
00000100:00100000:3.0:1776191418.635152:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba29c9bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630913792:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191418.635186:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000070c80d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630913536:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191418.638138:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d1c8a441 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630913984:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191418.638190:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191418.638254:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000016f04c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630913600:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191418.638406:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d908df0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630913856:12345-0@lo:8:kworker/u8:4.0 Request processed in 13350us (13830us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191418.638418:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2320
00000100:00080000:1.0:1776191418.638510:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191418.638516:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191418.638520:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048199cde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630913920:0@lo:8:kworker/u8:4.0
00000100:00080000:1.0:1776191418.638541:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191418.638544:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191418.638546:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007bb93380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630913856:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191418.639116:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630913984
00000100:00100000:3.0:1776191418.639171:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4677
00000100:00100000:3.0:1776191418.639177:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e89c7adb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630913984:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191418.639319:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e89c7adb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630913984:12345-0@lo:400:kworker/u8:4.0 Request processed in 141us (1129us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191418.639327:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4677
00000100:00100000:0.0:1776191418.642195:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d1c8a441 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630913984:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191419.386278:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191420.250954:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191420.251210:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191420.251251:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191420.251292:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191420.251333:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613799232
00000100:00100000:3.0:1776191420.251351:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613799040
00000100:00100000:0.0:1776191420.251398:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2032
00000100:00100000:3.0:1776191420.251399:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1757
00000100:00100000:3.0:1776191420.251412:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e89cfd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613799040:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191420.251413:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a01c31a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613799232:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191420.251501:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a01c31a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613799232:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 92us (292us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191420.251508:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2032
00000100:00100000:3.0:1776191420.255586:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e89cfd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613799040:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 4157us (4314us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191420.255604:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1757
00000100:00100000:1.0:1776191420.256522:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191420.256596:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613799296
00000100:00100000:1.0:1776191420.256631:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2322
00000100:00100000:1.0:1776191420.256638:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000023dd469f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613799296:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:1.0:1776191420.256745:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191420.256929:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000023dd469f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613799296:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 290us (411us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191420.256937:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2322
00000100:00100000:2.0:1776191420.261712:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613799104
00000100:00100000:2.0:1776191420.261809:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613799168
00000100:00100000:2.0:1776191420.261942:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4678
00000100:00100000:2.0:1776191420.261951:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000066f11e22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613799104:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191420.262077:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000066f11e22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613799104:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 126us (11131us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191420.262084:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4678
00000100:00100000:2.0:1776191420.262103:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4679
00000100:00100000:2.0:1776191420.262107:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b1044af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613799168:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191420.262129:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b1044af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613799168:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 22us (10838us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191420.262135:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4679
00010000:00010000:3.0:1776191420.410271:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191421.434382:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191421.690640:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008e802cd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630914112:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191421.690716:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191421.690922:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630914112
00000100:00100000:2.0:1776191421.690972:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3185
00000100:00100000:2.0:1776191421.690978:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004aff8356 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630914112:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191421.691009:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191421.691088:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004aff8356 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630914112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (373us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191421.691095:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3185
00000100:00100000:1.0:1776191421.691214:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008e802cd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630914112:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191422.458605:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191422.715049:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776191422.715069:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008a102519 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630914176:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191422.715146:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191422.715263:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630914176
00000100:00100000:2.0:1776191422.715313:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3186
00000100:00100000:2.0:1776191422.715318:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d795279f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630914176:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191422.715353:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191422.715414:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d795279f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630914176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (268us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191422.715420:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3186
00000100:00100000:0.0:1776191422.715500:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008a102519 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630914176:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191423.482244:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191423.738394:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1776191423.738425:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008e802cd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630914240:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191423.738495:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191423.738545:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630914240
00000100:00100000:2.0:1776191423.738586:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1607
00000100:00100000:2.0:1776191423.738591:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007bb93380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630914240:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191423.738619:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191423.738658:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007bb93380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630914240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (163us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191423.738664:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1607
00000100:00100000:2.0:1776191423.738721:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008e802cd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630914240:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191423.740910:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1776191423.741157:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e233a3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630914304:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191423.741303:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191423.741918:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630914304
00000100:00100000:0.0:1776191423.742191:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1608
00000100:00100000:0.0:1776191423.742199:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000078deb88d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630914304:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191423.742236:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191423.742295:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000078deb88d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630914304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (993us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191423.742302:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1608
00000100:00100000:1.0:1776191423.742391:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e233a3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630914304:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191423.742511:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048199cde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630914368:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191423.742550:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191423.742620:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630914368
00000100:00100000:3.0:1776191423.742664:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1758
00000100:00100000:3.0:1776191423.742669:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f3625dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630914368:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191423.742744:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000016f04c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630914432:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191423.742771:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191423.742803:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630914432
00000100:00100000:0.0:1776191423.742829:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4680
00000100:00100000:0.0:1776191423.742833:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fa1220ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630914432:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191423.742869:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fa1220ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630914432:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (97us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191423.742875:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4680
00000100:00100000:0.0:1776191423.742903:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000016f04c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630914432:0@lo:400:kworker/u8:2.0
00000100:00080000:2.0:1776191423.747058:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191423.747066:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191423.747070:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1776191423.747072:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023bc758a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630914560:0@lo:400:kworker/u8:2.0
00000100:00080000:2.0:1776191423.747079:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3956
00000100:00080000:2.0:1776191423.747083:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1776191423.747088:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191423.747112:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000016f04c4f x1862467630914688/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191423.747133:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191423.747136:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191423.747138:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191423.747140:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3956
00000100:00080000:2.0:1776191423.747142:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1776191423.747144:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191423.747158:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000008e802cd7 x1862467630914752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191423.747196:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b92c4097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630914816:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191423.747230:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191423.747265:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba29c9bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630914496:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191423.747295:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191423.747314:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f5a166e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630914880:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191423.747330:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191423.747371:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191423.747386:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1776191423.747391:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000552b8f18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630914624:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191423.747412:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191423.747442:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630914496
00000100:00100000:2.0:1776191423.747480:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630914624
00000100:00100000:0.0:1776191423.747491:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630914560
00000100:00100000:2.0:1776191423.747498:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3187
00000100:00100000:2.0:1776191423.747504:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f17e505c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630914496:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191423.747528:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630914880
00000100:00100000:0.0:1776191423.747553:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630914816
00000100:00100000:2.0:1776191423.747560:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f17e505c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630914496:12345-0@lo:400:kworker/u8:2.0 Request processed in 53us (263us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191423.747569:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3187
00000100:00100000:0.0:1776191423.747576:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4681
00000100:00100000:0.0:1776191423.747582:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dba56e7a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630914560:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191423.747589:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3188
00000100:00100000:2.0:1776191423.747595:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a96a54e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630914624:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191423.747625:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dba56e7a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630914560:12345-0@lo:400:kworker/u8:2.0 Request processed in 42us (396us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191423.747633:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4681
00000100:00100000:2.0:1776191423.747641:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a96a54e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630914624:12345-0@lo:400:kworker/u8:2.0 Request processed in 44us (227us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191423.747648:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3188
00000100:00100000:0.0:1776191423.747652:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4682
00000100:00100000:0.0:1776191423.747658:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ecd900ea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630914880:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191423.747679:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4683
00000100:00100000:2.0:1776191423.747684:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0fd09fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630914816:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191423.747691:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ecd900ea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630914880:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (359us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191423.747698:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4682
00000100:00100000:2.0:1776191423.747723:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0fd09fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630914816:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (350us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191423.747731:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4683
00000100:00100000:0.0:1776191423.747753:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023bc758a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630914560:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191423.747769:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000552b8f18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630914624:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191423.747783:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b92c4097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630914816:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191423.747805:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000016f04c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630914688:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191423.747820:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba29c9bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630914496:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191423.747832:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f5a166e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630914880:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191423.747840:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191423.747864:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008e802cd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630914752:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191423.747881:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630914688
00000100:00100000:0.0:1776191423.747887:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191423.748100:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630914752
00000100:00100000:2.0:1776191423.748119:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2323
00000100:00100000:2.0:1776191423.748122:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000079f65e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630914688:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191423.748224:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2324
00000100:00100000:0.0:1776191423.748229:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000eb05ee3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630914752:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191423.748380:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191423.748443:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f3625dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630914368:12345-0@lo:400:kworker/u8:2.0 Request processed in 5772us (5892us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191423.748452:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1758
00010000:02020000:2.0:1776191423.748557:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191423.748603:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000079f65e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630914688:12345-0@lo:8:kworker/u8:2.0 Request processed in 480us (765us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191423.748610:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2323
00000100:00080000:3.0:1776191423.748738:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191423.748742:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191423.748745:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000016f04c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630914688:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191423.749059:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000eb05ee3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630914752:12345-0@lo:8:kworker/u8:2.0 Request processed in 829us (1173us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191423.749066:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2324
00000100:00080000:3.0:1776191423.749214:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191423.749217:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191423.749220:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008e802cd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630914752:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191423.750671:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048199cde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630914368:0@lo:400:kworker/u8:2.0
00010000:00010000:3.0:1776191424.506258:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191425.370700:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191425.370742:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191425.370777:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191425.370834:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191425.370867:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613799552
00000100:00100000:1.0:1776191425.370873:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613799360
00000100:00100000:1.0:1776191425.370912:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1759
00000100:00100000:0.0:1776191425.370916:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2033
00000100:00100000:1.0:1776191425.370919:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e270043d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613799360:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191425.370921:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a102519 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613799552:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191425.371000:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613799488
00000100:00100000:2.0:1776191425.371062:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613799424
00000100:00100000:1.0:1776191425.371474:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e270043d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613799360:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 553us (780us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191425.371482:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1759
00000100:00100000:2.0:1776191425.374067:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4684
00000100:00100000:2.0:1776191425.374080:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c5ac88f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613799488:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191425.376648:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a102519 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613799552:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 5716us (5804us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191425.376894:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2033
00000100:00100000:1.0:1776191425.376978:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191425.380426:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4685
00000100:00100000:3.0:1776191425.380440:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003462e3ec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613799424:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191425.380511:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613799616
00000100:00100000:3.0:1776191425.380523:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003462e3ec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613799424:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 86us (9746us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191425.380530:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4685
00000100:00100000:0.0:1776191425.380539:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2325
00000100:00100000:0.0:1776191425.380544:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d1c8a441 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613799616:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:0.0:1776191425.380641:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191425.380677:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d1c8a441 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613799616:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 132us (3846us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191425.380684:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2325
00000100:00100000:2.0:1776191425.381143:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c5ac88f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613799488:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 7063us (10399us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191425.381154:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4684
00010000:00010000:3.0:1776191425.530665:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191426.555245:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191426.810431:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f5a166e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630914944:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191426.810496:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191426.810645:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630914944
00000100:00100000:1.0:1776191426.810694:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3189
00000100:00100000:1.0:1776191426.810700:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b847a9ef pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630914944:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191426.810732:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191426.810782:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b847a9ef pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630914944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (288us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191426.810789:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3189
00000100:00100000:0.0:1776191426.810912:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f5a166e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630914944:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191427.578301:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191427.834305:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000001c99791 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630915008:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191427.834375:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191427.834461:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630915008
00000100:00100000:3.0:1776191427.834517:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3190
00000100:00100000:3.0:1776191427.834523:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e2f30b71 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630915008:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191427.834556:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191427.834610:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e2f30b71 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630915008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (236us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191427.834618:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3190
00000100:00100000:1.0:1776191427.834707:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000001c99791 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630915008:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191428.603616:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191428.858271:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b92c4097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630915072:0@lo:13:osp-pre-0-0.0
00000100:00080000:3.0:1776191428.858272:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191428.858280:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191428.858285:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191428.858291:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3961
00000100:00080000:3.0:1776191428.858303:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1776191428.858310:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191428.858332:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000e7e191b3 x1862467630915648/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191428.858336:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057cc3d6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630915136:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191428.858349:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1776191428.858360:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191428.858364:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191428.858366:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191428.858369:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3961
00000100:00080000:3.0:1776191428.858372:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1776191428.858390:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191428.858399:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000c9cf495d x1862467630915712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191428.858534:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630915072
00000100:00100000:3.0:1776191428.858568:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1609
00000100:00100000:3.0:1776191428.858573:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000001c99791 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630915072:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191428.858598:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191428.858649:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7e191b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630915648:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191428.866605:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191428.866664:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e56d17f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630915392:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191428.866785:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e233a3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630915328:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191428.866835:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191428.866868:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004c05da7e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630915584:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191428.866891:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191428.866910:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:1.0:1776191428.866916:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008629d0f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630915264:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191428.866937:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191428.867069:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000070c80d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630915520:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191428.867095:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191428.867142:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630915584
00000100:00100000:1.0:1776191428.867181:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630915520
00000100:00100000:1.0:1776191428.867203:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2034
00000100:00100000:1.0:1776191428.867209:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009189961c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3364:x1862467630915584:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191428.867334:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191428.867363:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000242a6510 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630915776:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191428.867385:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191428.867403:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [3->2]
00000100:00100000:0.0:1776191428.867409:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdd224e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630915200:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191428.867435:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191428.867452:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008e802cd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630915456:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191428.867546:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009189961c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3364:x1862467630915584:12345-0@lo:400:kworker/u8:2.0 Request processed in 336us (653us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191428.867554:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2034
00000100:00100000:1.0:1776191428.867570:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2035
00000100:00100000:1.0:1776191428.867574:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009df06d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630915520:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191428.867599:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009df06d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630915520:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (505us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191428.867604:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2035
00000100:00100000:1.0:1776191428.867642:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000070c80d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630915520:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191428.867653:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004c05da7e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630915584:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191428.867702:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630915264
00000100:00100000:1.0:1776191428.867725:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630915392
00000100:00100000:1.0:1776191428.867737:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630915776
00000100:00100000:1.0:1776191428.867749:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4686
00000100:00100000:1.0:1776191428.867752:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003b6ef48d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630915264:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191428.867786:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003b6ef48d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630915264:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (849us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191428.867792:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4686
00000100:00100000:1.0:1776191428.867803:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4687
00000100:00100000:1.0:1776191428.867806:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000985b93ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630915392:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191428.867830:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000985b93ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630915392:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (497us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191428.867836:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4687
00000100:00100000:1.0:1776191428.867845:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4688
00000100:00100000:1.0:1776191428.867848:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000275038be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630915776:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191428.867870:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000275038be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630915776:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (485us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191428.867875:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4688
00000100:00100000:1.0:1776191428.867891:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630915136
00000100:00100000:1.0:1776191428.867910:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1610
00000100:00100000:1.0:1776191428.867914:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000097dea8b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630915136:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191428.867927:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191428.868070:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000097dea8b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630915136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 154us (1472us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191428.868076:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1610
00000100:00100000:1.0:1776191428.868099:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630915328
00000100:00100000:1.0:1776191428.868122:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3191
00000100:00100000:1.0:1776191428.868126:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4fb1a2d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630915328:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191428.868153:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4fb1a2d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630915328:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (1319us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191428.868162:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3191
00000100:00100000:1.0:1776191428.868188:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008629d0f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630915264:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191428.868198:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e233a3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630915328:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191428.868242:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630915200
00000100:00100000:1.0:1776191428.868370:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1760
00000100:00100000:1.0:1776191428.868374:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fecbd6f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630915200:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191428.868444:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191428.868495:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fecbd6f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630915200:12345-0@lo:400:kworker/u8:2.0 Request processed in 119us (1058us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191428.868502:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1760
00000100:00100000:1.0:1776191428.868553:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630915456
00000100:00100000:0.0:1776191428.868563:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009eabfd74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630915840:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191428.868575:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3192
00000100:00100000:1.0:1776191428.868580:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d2db40d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630915456:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191428.868593:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191428.868622:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d2db40d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630915456:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (177us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191428.868626:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000242a6510 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630915776:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191428.868633:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3192
00000100:00100000:0.0:1776191428.868651:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057cc3d6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630915136:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191428.868666:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630915840
00000100:00100000:0.0:1776191428.868669:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e56d17f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630915392:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191428.868692:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4689
00000100:00100000:1.0:1776191428.868696:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000020d568d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630915840:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191428.868722:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000020d568d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630915840:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (132us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191428.868728:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4689
00000100:00100000:3.0:1776191428.869127:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000001c99791 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630915072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10551us (10779us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191428.869140:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1609
00000100:00100000:1.0:1776191428.869157:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b92c4097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630915072:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191428.869225:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191428.869511:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9cf495d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630915712:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191428.869537:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191428.869582:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdd224e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630915200:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191428.869594:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008e802cd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630915456:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191428.869603:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009eabfd74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630915840:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191428.869626:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630915648
00000100:00100000:1.0:1776191428.869655:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630915712
00000100:00100000:1.0:1776191428.869673:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2326
00000100:00100000:1.0:1776191428.869678:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b92c4097 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630915648:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191428.869831:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2327
00000100:00100000:3.0:1776191428.869835:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f5a166e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630915712:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191428.869924:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191428.869966:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f5a166e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630915712:12345-0@lo:8:kworker/u8:2.0 Request processed in 130us (428us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191428.869972:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2327
00010000:02020000:1.0:1776191428.870141:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191428.870168:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b92c4097 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630915648:12345-0@lo:8:kworker/u8:2.0 Request processed in 490us (944us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191428.870175:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2326
00000100:00080000:0.0:1776191428.870818:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191428.870824:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191428.870828:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7e191b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630915648:0@lo:8:kworker/u8:2.0
00000100:00080000:0.0:1776191428.870838:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191428.870840:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191428.870843:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9cf495d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630915712:0@lo:8:kworker/u8:2.0
00010000:00010000:3.0:1776191429.626264:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191430.495184:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191430.495243:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191430.495278:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191430.495300:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191430.495370:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191430.495405:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613799872
00000100:00100000:3.0:1776191430.495456:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613799936
00000100:00100000:3.0:1776191430.495471:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2036
00000100:00100000:3.0:1776191430.495477:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000906a5df3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613799872:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191430.495544:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000906a5df3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613799872:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 66us (244us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191430.495552:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2036
00000100:00100000:3.0:1776191430.495567:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2328
00000100:00100000:3.0:1776191430.495570:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000276fe5cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613799936:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:3.0:1776191430.495675:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191430.495700:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000276fe5cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613799936:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 128us (331us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191430.495707:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2328
00000100:00100000:1.0:1776191430.496330:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613799680
00000100:00100000:1.0:1776191430.496380:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1761
00000100:00100000:1.0:1776191430.496385:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f7ed2aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613799680:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191430.496426:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f7ed2aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613799680:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 40us (1250us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191430.496434:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1761
00000100:00100000:1.0:1776191430.496491:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613799808
00000100:00100000:1.0:1776191430.496515:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613799744
00000100:00100000:1.0:1776191430.496532:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4690
00000100:00100000:1.0:1776191430.496536:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ed098f19 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613799808:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191430.496567:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ed098f19 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613799808:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 30us (1325us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191430.496572:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4690
00000100:00100000:1.0:1776191430.496583:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4691
00000100:00100000:1.0:1776191430.496587:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000665b727b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613799744:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191430.496619:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000665b727b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613799744:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 20us (1330us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191430.496626:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4691
00010000:00010000:3.0:1776191430.650514:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191431.674285:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191431.930890:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630915904:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191431.930958:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191431.931805:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630915904
00000100:00100000:2.0:1776191431.931865:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3193
00000100:00100000:2.0:1776191431.931870:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c02746a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630915904:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191431.931904:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191431.931963:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c02746a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630915904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (1005us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191431.931969:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3193
00000100:00100000:3.0:1776191431.932352:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630915904:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191432.698960:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191432.954404:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776191432.954423:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c82d865 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630915968:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191432.954501:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191432.954704:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630915968
00000100:00100000:1.0:1776191432.954750:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3194
00000100:00100000:1.0:1776191432.954756:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b341218 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630915968:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191432.954787:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191432.954841:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b341218 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630915968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (341us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191432.954848:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3194
00000100:00100000:0.0:1776191432.954935:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c82d865 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630915968:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191433.722315:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191433.978454:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008ba53a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630916032:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191433.978527:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1776191433.978546:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191433.978552:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191433.978555:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1776191433.978616:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045d4856e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630916224:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191433.978646:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191433.978660:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048199cde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630916480:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191433.978695:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191433.978714:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:3.0:1776191433.978720:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028cc0665 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630916160:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191433.978743:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191433.978758:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008e802cd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630916416:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191433.978776:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191433.978814:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630916160
00000100:00100000:3.0:1776191433.978851:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4692
00000100:00100000:3.0:1776191433.978856:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e41a7454 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630916160:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191433.978902:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e41a7454 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630916160:12345-0@lo:400:kworker/u8:2.0 Request processed in 44us (158us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191433.978909:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4692
00000100:00100000:3.0:1776191433.978929:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630916224
00000100:00100000:3.0:1776191433.978950:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3195
00000100:00100000:3.0:1776191433.978953:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000039ea1fd6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630916224:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191433.978981:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000039ea1fd6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630916224:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (335us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191433.978987:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3195
00000100:00100000:3.0:1776191433.979005:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630916480
00000100:00100000:3.0:1776191433.979056:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630916416
00000100:00100000:3.0:1776191433.979073:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2037
00000100:00100000:3.0:1776191433.979077:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007cae42a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630916480:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191433.979107:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007cae42a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630916480:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (411us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191433.979113:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2037
00000100:00100000:3.0:1776191433.979136:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2038
00000100:00100000:3.0:1776191433.979139:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009065a894 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630916416:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191433.979161:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009065a894 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630916416:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (386us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191433.979166:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2038
00000100:00100000:3.0:1776191433.979203:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028cc0665 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630916160:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191433.979213:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008e802cd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630916416:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191433.979221:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045d4856e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630916224:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191433.979228:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048199cde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630916480:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191433.979288:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630916032
00000100:00100000:3.0:1776191433.979309:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1611
00000100:00100000:3.0:1776191433.979313:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000418a6d34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630916032:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191433.979334:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191433.979361:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000418a6d34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630916032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (837us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191433.979370:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1611
00000100:00100000:3.0:1776191433.979388:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037d4716c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630916096:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191433.979415:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191433.979430:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b6af7b47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630916352:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191433.979449:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191433.979462:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1776191433.979467:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000059801540 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630916288:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191433.979485:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191433.979506:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630916288
00000100:00100000:3.0:1776191433.979526:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4693
00000100:00100000:3.0:1776191433.979530:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081ef8bd2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630916288:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191433.979560:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081ef8bd2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630916288:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (75us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191433.979565:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4693
00000100:00100000:3.0:1776191433.979581:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630916352
00000100:00100000:3.0:1776191433.979598:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3196
00000100:00100000:3.0:1776191433.979601:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e80ba0d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630916352:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191433.979627:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e80ba0d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630916352:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (178us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191433.979632:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3196
00000100:00100000:3.0:1776191433.979653:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000059801540 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630916288:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191433.979660:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b6af7b47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630916352:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191433.979681:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630916096
00000100:00100000:3.0:1776191433.979703:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1762
00000100:00100000:3.0:1776191433.979707:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000328cc67f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630916096:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191433.979736:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000328cc67f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630916096:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (321us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191433.979741:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1762
00000100:00100000:3.0:1776191433.979770:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037d4716c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630916096:0@lo:400:kworker/u8:2.0
00000100:00080000:0.0:1776191433.980919:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3966
00000100:00080000:0.0:1776191433.980924:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191433.980929:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191433.980958:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000016f04c4f x1862467630916608/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191433.980977:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1776191433.980981:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00080000:0.0:1776191433.980982:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191433.980986:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191433.980991:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3966
00000100:00080000:0.0:1776191433.980993:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00100000:2.0:1776191433.980996:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d07f501 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630916544:0@lo:13:osp-pre-0-0.0
00000100:00080000:0.0:1776191433.980998:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191433.981015:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000ba29c9bf x1862467630916672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191433.981071:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191433.981099:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000552b8f18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630916736:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191433.981104:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000016f04c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630916608:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191433.981132:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191433.981156:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191433.981170:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630916544
00000100:00100000:0.0:1776191433.981182:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba29c9bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630916672:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191433.981203:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1612
00000100:00100000:2.0:1776191433.981211:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe1c3a77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630916544:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191433.981212:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00002000:00000024:2.0:1776191433.981231:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191433.981246:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630916608
00000100:00100000:2.0:1776191433.981267:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe1c3a77 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630916544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (198us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191433.981274:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1612
00000100:00100000:2.0:1776191433.981295:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630916736
00000100:00100000:2.0:1776191433.981315:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4694
00000100:00100000:2.0:1776191433.981318:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000055aaefe0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630916736:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191433.981337:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630916672
00000100:00100000:2.0:1776191433.981346:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000055aaefe0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630916736:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (224us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191433.981352:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4694
00000100:00100000:0.0:1776191433.981364:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2329
00000100:00100000:0.0:1776191433.981371:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048199cde pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630916608:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191433.981386:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000552b8f18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630916736:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191433.981397:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d07f501 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630916544:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191433.981423:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023bc758a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630916800:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191433.981443:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191433.981462:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630916800
00000100:00100000:2.0:1776191433.981478:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4695
00000100:00100000:2.0:1776191433.981481:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005d07f501 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630916800:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191433.981506:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005d07f501 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630916800:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (63us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191433.981511:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4695
00000100:00100000:2.0:1776191433.981528:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023bc758a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630916800:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191433.981543:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2330
00000100:00100000:2.0:1776191433.981547:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027e578e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630916672:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191433.981678:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191433.981708:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027e578e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630916672:12345-0@lo:8:kworker/u8:2.0 Request processed in 160us (500us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191433.981714:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2330
00010000:02020000:0.0:1776191433.981747:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191433.981863:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048199cde pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630916608:12345-0@lo:8:kworker/u8:2.0 Request processed in 491us (708us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191433.981869:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2329
00000100:00080000:0.0:1776191433.981898:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191433.981902:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191433.981905:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000016f04c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630916608:0@lo:8:kworker/u8:2.0
00000100:00080000:0.0:1776191433.981913:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191433.981915:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191433.981917:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba29c9bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630916672:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191433.982309:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008ba53a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630916032:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1776191434.746270:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191435.618455:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191435.618601:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191435.618639:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191435.618667:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191435.618690:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191435.618905:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613800000
00000100:00100000:2.0:1776191435.618959:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613800128
00000100:00100000:2.0:1776191435.619003:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613800064
00000100:00100000:2.0:1776191435.619025:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4696
00000100:00100000:2.0:1776191435.619060:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000037cd311c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613800128:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191435.619137:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000037cd311c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613800128:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 105us (499us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191435.619144:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4696
00000100:00100000:2.0:1776191435.619160:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4697
00000100:00100000:2.0:1776191435.619164:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f8de323 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613800064:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191435.619182:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f8de323 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613800064:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 18us (516us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191435.619187:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4697
00000100:00100000:1.0:1776191435.620067:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1763
00000100:00100000:1.0:1776191435.620074:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019aa1469 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613800000:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191435.620128:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019aa1469 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613800000:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 54us (1528us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191435.620135:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1763
00000100:00100000:2.0:1776191435.625618:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613800192
00000100:00100000:2.0:1776191435.625684:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2039
00000100:00100000:2.0:1776191435.625692:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000008ba53a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613800192:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191435.625817:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000008ba53a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613800192:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 126us (7127us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191435.625825:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2039
00000100:00100000:0.0:1776191435.626213:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613800256
00000100:00100000:3.0:1776191435.626258:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2331
00000100:00100000:3.0:1776191435.626265:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae6c8b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613800256:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:3.0:1776191435.626364:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191435.626411:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae6c8b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613800256:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 146us (7964us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191435.626419:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2331
00010000:00010000:3.0:1776191435.773969:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191436.794350:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191437.053580:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007ea65731 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630916864:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191437.053653:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191437.053767:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630916864
00000100:00100000:1.0:1776191437.053818:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3197
00000100:00100000:1.0:1776191437.053824:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9cf495d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630916864:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191437.053856:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191437.053909:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9cf495d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630916864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (258us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191437.053916:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3197
00000100:00100000:2.0:1776191437.053997:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007ea65731 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630916864:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191437.819066:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191438.074507:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630916928:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191438.074578:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191438.074673:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630916928
00000100:00100000:3.0:1776191438.074720:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3198
00000100:00100000:3.0:1776191438.074726:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002fc9e52b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630916928:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191438.074761:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191438.074808:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002fc9e52b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630916928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (230us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191438.074814:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3198
00000100:00100000:0.0:1776191438.074889:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630916928:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191438.842355:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1776191439.098305:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191439.098312:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191439.098315:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191439.098323:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3972
00000100:00080000:1.0:1776191439.098327:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191439.098332:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191439.098351:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000057cc3d6f x1862467630917440/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191439.098369:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191439.098372:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191439.098374:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191439.098377:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3972
00000100:00080000:1.0:1776191439.098378:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191439.098382:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191439.098391:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000003e233a3c x1862467630917504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191439.098406:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007c94492b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630916992:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191439.098428:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a26e20f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630917120:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191439.098504:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630917184:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191439.098628:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000161dca59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630917056:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191439.101467:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191439.101519:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e56d17f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630917376:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191439.101565:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191439.101596:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009eabfd74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630917760:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191439.101618:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191439.101656:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057cc3d6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630917440:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191439.101692:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191439.101709:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e233a3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630917504:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191439.101729:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191439.101777:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630917760
00000100:00100000:1.0:1776191439.101828:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1613
00000100:00100000:1.0:1776191439.101834:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a81e70bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630917760:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191439.101864:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191439.101905:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a81e70bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630917760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (286us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191439.101912:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1613
00000100:00100000:1.0:1776191439.101935:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630917376
00000100:00100000:1.0:1776191439.101957:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630917440
00000100:00100000:1.0:1776191439.101971:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630917504
00000100:00100000:1.0:1776191439.101985:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2040
00000100:00100000:1.0:1776191439.101989:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c7c28c8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630917376:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191439.102029:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c7c28c8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630917376:12345-0@lo:400:kworker/u8:4.0 Request processed in 38us (464us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191439.102052:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2040
00000100:00100000:1.0:1776191439.102064:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2332
00000100:00100000:1.0:1776191439.102067:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ca51694 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630917440:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191439.103271:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191439.103338:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630916992
00000100:00100000:2.0:1776191439.103382:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1764
00000100:00100000:2.0:1776191439.103386:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe981ad6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630916992:12345-0@lo:400:kworker/u8:4.0
00010000:02020000:1.0:1776191439.103407:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191439.103445:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe981ad6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630916992:12345-0@lo:400:kworker/u8:4.0 Request processed in 57us (179us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191439.103453:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1764
00000100:00100000:1.0:1776191439.103475:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ca51694 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630917440:12345-0@lo:8:kworker/u8:4.0 Request processed in 1404us (1781us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191439.103483:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2332
00000100:00100000:2.0:1776191439.103491:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c82d865 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630917248:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191439.103501:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2333
00000100:00100000:1.0:1776191439.103505:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b5928219 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630917504:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191439.103524:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191439.103555:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000070c80d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630917632:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191439.103579:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:02020000:1.0:1776191439.103589:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191439.103604:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630917632
00000100:00100000:1.0:1776191439.103623:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b5928219 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630917504:12345-0@lo:8:kworker/u8:4.0 Request processed in 116us (1892us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191439.103631:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2333
00000100:00100000:2.0:1776191439.103636:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4698
00000100:00100000:2.0:1776191439.103642:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002982660c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630917632:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191439.103674:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002982660c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630917632:12345-0@lo:400:kworker/u8:4.0 Request processed in 32us (94us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191439.103680:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4698
00000100:00100000:2.0:1776191439.103711:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007c94492b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630916992:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191439.103735:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000070c80d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630917632:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191439.103772:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630917120
00000100:00100000:2.0:1776191439.104804:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630917248
00000100:00100000:2.0:1776191439.104832:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3199
00000100:00100000:2.0:1776191439.104837:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019e5e056 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630917120:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191439.104894:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019e5e056 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630917120:12345-0@lo:400:kworker/u8:4.0 Request processed in 57us (3436us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191439.104900:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3199
00000100:00100000:2.0:1776191439.104913:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3200
00000100:00100000:2.0:1776191439.104916:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ea65731 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630917248:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191439.104944:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ea65731 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630917248:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (1422us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191439.104949:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3200
00000100:00100000:2.0:1776191439.104986:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c82d865 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630917248:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191439.105100:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009eabfd74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630917760:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191439.105115:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a26e20f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630917120:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191439.105124:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e56d17f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630917376:0@lo:400:kworker/u8:4.0
00000100:00080000:2.0:1776191439.105174:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191439.105179:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191439.105182:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057cc3d6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630917440:0@lo:8:kworker/u8:4.0
00000100:00080000:2.0:1776191439.105192:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191439.105195:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191439.105197:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e233a3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630917504:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191439.106880:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191439.106933:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008629d0f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630917568:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191439.106974:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191439.107062:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630917184
00000100:00100000:0.0:1776191439.107104:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630917568
00000100:00100000:1.0:1776191439.107374:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4699
00000100:00100000:1.0:1776191439.107380:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba296d84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630917184:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191439.107679:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4700
00000100:00100000:0.0:1776191439.107684:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c1893c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630917568:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191439.107793:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191439.107855:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfdd224e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630917312:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191439.107885:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba296d84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630917184:12345-0@lo:400:kworker/u8:4.0 Request processed in 503us (1011us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191439.107895:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191439.107897:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4699
00000100:00100000:3.0:1776191439.107918:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7e191b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630917696:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191439.107924:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630917056
00000100:00100000:3.0:1776191439.107955:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191439.107983:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c1893c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630917568:12345-0@lo:400:kworker/u8:4.0 Request processed in 297us (1007us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191439.107992:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4700
00000100:00100000:3.0:1776191439.107995:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630917696
00000100:00100000:0.0:1776191439.108008:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4701
00000100:00100000:0.0:1776191439.108022:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000242a6510 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630917056:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191439.108053:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1614
00000100:00100000:3.0:1776191439.108059:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009eabfd74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630917696:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191439.108075:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000242a6510 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630917056:12345-0@lo:400:kworker/u8:4.0 Request processed in 52us (283us total) trans 0 rc 0/0
00002000:00000024:3.0:1776191439.108077:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191439.108085:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4701
00000100:00100000:3.0:1776191439.108319:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009eabfd74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630917696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 259us (371us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191439.108326:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1614
00000100:00100000:3.0:1776191439.108356:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000161dca59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630917056:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191439.108370:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7e191b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630917696:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191439.108420:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630917184:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191439.108430:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008629d0f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630917568:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191439.114089:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630917312
00000100:00100000:0.0:1776191439.114171:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2041
00000100:00100000:0.0:1776191439.114178:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c05da7e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630917312:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191439.114473:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c05da7e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630917312:12345-0@lo:400:kworker/u8:4.0 Request processed in 295us (6579us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191439.114482:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2041
00000100:00100000:3.0:1776191439.123108:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfdd224e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630917312:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191439.866245:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191440.732840:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191440.732888:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191440.732930:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191440.732954:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191440.733167:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191440.733203:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613800384
00000100:00100000:3.0:1776191440.733258:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613800448
00000100:00100000:3.0:1776191440.733277:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4702
00000100:00100000:3.0:1776191440.733283:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e7e191b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613800384:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191440.733360:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e7e191b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613800384:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 75us (527us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191440.733367:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4702
00000100:00100000:3.0:1776191440.733384:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4703
00000100:00100000:3.0:1776191440.733388:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000037d4716c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613800448:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191440.733410:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000037d4716c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613800448:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 21us (456us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191440.733414:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4703
00000100:00100000:3.0:1776191440.733431:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613800320
00000100:00100000:3.0:1776191440.733454:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1765
00000100:00100000:3.0:1776191440.733458:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001479089e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613800320:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191440.733483:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001479089e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613800320:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 24us (554us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191440.733489:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1765
00000100:00100000:2.0:1776191440.733828:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613800512
00000100:00100000:2.0:1776191440.733865:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613800576
00000100:00100000:2.0:1776191440.733888:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2042
00000100:00100000:2.0:1776191440.733892:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e802cd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613800512:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191440.733932:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e802cd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613800512:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 38us (1044us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191440.733938:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2042
00000100:00100000:2.0:1776191440.733950:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2334
00000100:00100000:2.0:1776191440.733954:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b6af7b47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613800576:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:2.0:1776191440.734082:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191440.734109:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b6af7b47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613800576:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 153us (951us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191440.734118:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2334
00010000:00010000:3.0:1776191440.890281:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191441.914521:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191442.170433:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191442.170458:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f0579a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630917824:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191442.170524:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191442.170713:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630917824
00000100:00100000:2.0:1776191442.170763:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3201
00000100:00100000:2.0:1776191442.170769:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004270d9b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630917824:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191442.170810:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191442.170859:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004270d9b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630917824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (335us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191442.170865:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3201
00000100:00100000:1.0:1776191442.171089:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f0579a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630917824:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191442.939570:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191443.194795:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7c3b55d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630917888:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191443.194861:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191443.194940:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630917888
00000100:00100000:2.0:1776191443.195002:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3202
00000100:00100000:2.0:1776191443.195008:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008eb36e2d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630917888:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191443.195061:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191443.200663:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008eb36e2d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630917888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5645us (5793us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191443.200687:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3202
00000100:00100000:0.0:1776191443.201310:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7c3b55d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630917888:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191443.962404:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191444.218658:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000059801540 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630917952:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191444.218723:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191444.218764:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630917952
00000100:00100000:3.0:1776191444.218803:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1615
00000100:00100000:3.0:1776191444.218809:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000045d4856e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630917952:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191444.218837:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191444.218872:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000045d4856e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630917952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (150us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191444.218879:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1615
00000100:00100000:3.0:1776191444.218934:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000059801540 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630917952:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191444.221269:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191444.221289:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030eda894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630918016:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191444.221349:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191444.221506:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093500675 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630918080:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191444.221544:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191444.221559:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630918016
00000100:00100000:2.0:1776191444.221606:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1616
00000100:00100000:2.0:1776191444.221612:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004fd8278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630918016:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191444.221690:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6387b57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630918144:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191444.221722:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191444.221758:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630918144
00000100:00100000:3.0:1776191444.221787:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4704
00000100:00100000:3.0:1776191444.221791:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000059801540 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630918144:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191444.221834:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000059801540 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630918144:12345-0@lo:400:kworker/u8:2.0 Request processed in 42us (112us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191444.221841:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4704
00000100:00100000:1.0:1776191444.221863:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630918080
00000100:00100000:3.0:1776191444.221887:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6387b57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630918144:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191444.221913:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1766
00000100:00100000:1.0:1776191444.221919:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fc1666bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630918080:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191444.221955:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fc1666bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630918080:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (413us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191444.221961:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1766
00000100:00100000:1.0:1776191444.221997:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093500675 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630918080:0@lo:400:kworker/u8:2.0
00000100:00080000:0.0:1776191444.222020:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191444.222025:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191444.222028:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191444.222051:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3977
00000100:00080000:0.0:1776191444.222054:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191444.222058:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191444.222076:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000e7a43fc4 x1862467630918400/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191444.222128:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f93569a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630918336:0@lo:400:kworker/u8:2.0
00002000:00000024:2.0:1776191444.222134:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191444.222175:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004fd8278 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630918016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 562us (826us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191444.222182:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1616
00000100:00100000:2.0:1776191444.222219:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003824609a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630918272:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191444.222243:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191444.222260:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1776191444.222266:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a6e01f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630918208:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191444.222287:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191444.222309:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630918272
00000100:00100000:2.0:1776191444.222333:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4705
00000100:00100000:2.0:1776191444.222338:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d68d7e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630918272:12345-0@lo:400:kworker/u8:2.0
00000100:00080000:0.0:1776191444.222345:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191444.222350:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191444.222352:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191444.222357:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3977
00000100:00080000:0.0:1776191444.222359:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191444.222363:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191444.222377:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000d72c3363 x1862467630918464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191444.222414:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630918208
00000100:00100000:3.0:1776191444.222433:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b397ad6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630918528:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191444.222442:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3203
00000100:00100000:0.0:1776191444.222448:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ef9b9d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630918208:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191444.222475:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191444.222505:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093500675 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630918592:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191444.222526:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191444.222549:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030eda894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630918016:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191444.222788:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630918336
00000100:00100000:1.0:1776191444.222805:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3204
00000100:00100000:1.0:1776191444.222809:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e56aacf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630918336:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191444.222845:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e56aacf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630918336:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (370us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191444.222852:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3204
00000100:00100000:1.0:1776191444.222872:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f93569a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630918336:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191444.222973:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630918592
00000100:00100000:1.0:1776191444.222996:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4706
00000100:00100000:1.0:1776191444.222999:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d5dde41 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630918592:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191444.223125:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d5dde41 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630918592:12345-0@lo:400:kworker/u8:2.0 Request processed in 124us (598us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191444.223132:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4706
00000100:00100000:1.0:1776191444.223377:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093500675 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630918592:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191444.223421:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003824609a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630918272:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191444.223437:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7a43fc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630918400:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191444.223464:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191444.223482:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d72c3363 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630918464:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191444.223499:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191444.223521:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630918400
00000100:00100000:1.0:1776191444.223536:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630918464
00000100:00100000:1.0:1776191444.223549:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2335
00000100:00100000:1.0:1776191444.223883:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000054825189 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630918400:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:1.0:1776191444.224181:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191444.224293:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000054825189 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630918400:12345-0@lo:8:kworker/u8:2.0 Request processed in 411us (828us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191444.224301:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2335
00000100:00100000:1.0:1776191444.224319:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2336
00000100:00100000:1.0:1776191444.224323:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f7c3b55d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630918464:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:1.0:1776191444.224402:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191444.224426:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f7c3b55d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630918464:12345-0@lo:8:kworker/u8:2.0 Request processed in 102us (926us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191444.224431:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2336
00000100:00080000:1.0:1776191444.224460:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191444.224464:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191444.224467:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7a43fc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630918400:0@lo:8:kworker/u8:2.0
00000100:00080000:1.0:1776191444.224475:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191444.224478:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191444.224480:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d72c3363 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630918464:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191444.227732:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d68d7e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630918272:12345-0@lo:400:kworker/u8:2.0 Request processed in 5386us (5481us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191444.227748:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4705
00000100:00100000:3.0:1776191444.229152:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191444.229333:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ef9b9d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630918208:12345-0@lo:400:kworker/u8:2.0 Request processed in 6883us (7044us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191444.229345:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3203
00000100:00100000:1.0:1776191444.229421:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a6e01f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630918208:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191444.230941:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630918528
00000100:00100000:2.0:1776191444.231010:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4707
00000100:00100000:2.0:1776191444.231016:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028cc0665 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630918528:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191444.231201:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028cc0665 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630918528:12345-0@lo:400:kworker/u8:2.0 Request processed in 184us (2054us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191444.231209:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4707
00000100:00100000:3.0:1776191444.231291:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b397ad6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630918528:0@lo:400:kworker/u8:2.0
00010000:00010000:3.0:1776191444.986270:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191445.850646:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191445.850691:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191445.850808:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613800704
00000100:00100000:1.0:1776191445.850887:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4708
00000100:00100000:1.0:1776191445.850894:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f5bae6c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613800704:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191445.850968:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f5bae6c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613800704:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 73us (329us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191445.850977:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4708
00000100:00100000:3.0:1776191445.851346:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191445.851381:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191445.851444:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613800640
00000100:00100000:0.0:1776191445.851480:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1767
00000100:00100000:0.0:1776191445.851484:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000280cef61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613800640:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191445.851521:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000280cef61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613800640:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 35us (176us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191445.851527:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1767
00000100:00100000:1.0:1776191445.851688:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613800768
00000100:00100000:1.0:1776191445.851722:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4709
00000100:00100000:1.0:1776191445.851727:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000065875d20 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613800768:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191445.851760:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000065875d20 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613800768:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 32us (379us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191445.851766:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4709
00000100:00100000:2.0:1776191445.853577:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613800832
00000100:00100000:2.0:1776191445.853638:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2043
00000100:00100000:2.0:1776191445.853645:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000020784d50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613800832:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191445.853765:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000020784d50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613800832:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 119us (3073us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191445.853772:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2043
00000100:00100000:0.0:1776191445.856961:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191445.857330:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613800896
00000100:00100000:2.0:1776191445.857385:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2337
00000100:00100000:2.0:1776191445.857392:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b397ad6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613800896:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:2.0:1776191445.857492:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191445.860454:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b397ad6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613800896:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 3054us (3495us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191445.860470:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2337
00010000:00010000:3.0:1776191446.010552:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191447.034540:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191447.292001:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c634116b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630918656:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191447.292087:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191447.292339:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630918656
00000100:00100000:0.0:1776191447.292394:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3205
00000100:00100000:0.0:1776191447.292401:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000118d0482 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630918656:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191447.292432:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191447.292471:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000118d0482 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630918656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (385us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191447.292478:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3205
00000100:00100000:1.0:1776191447.292912:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c634116b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630918656:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191448.058479:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191448.314469:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191448.318687:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000417ffd59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630918720:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191448.318760:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191448.318859:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630918720
00000100:00100000:2.0:1776191448.318923:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3206
00000100:00100000:2.0:1776191448.318929:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a6e01f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630918720:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191448.318965:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191448.319024:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a6e01f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630918720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (265us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191448.319031:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3206
00000100:00100000:0.0:1776191448.319150:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000417ffd59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630918720:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191449.082340:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191449.338916:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000039f9568 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630918784:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191449.338989:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191449.339144:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630918784
00000100:00100000:3.0:1776191449.339194:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1617
00000100:00100000:3.0:1776191449.339200:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d72c3363 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630918784:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191449.339229:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191449.339268:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d72c3363 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630918784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (280us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191449.339275:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1617
00000100:00100000:3.0:1776191449.339366:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000042aec8a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630918848:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191449.339401:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191449.339568:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000039f9568 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630918784:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191449.339598:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000090a9e988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630918912:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191449.339634:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191449.339660:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630918912
00000100:00100000:0.0:1776191449.339686:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1618
00000100:00100000:0.0:1776191449.339690:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e7a43fc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630918912:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191449.339702:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191449.339731:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e7a43fc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630918912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (97us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191449.339737:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1618
00000100:00100000:0.0:1776191449.339763:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000090a9e988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630918912:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191449.339804:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630918848
00000100:00100000:0.0:1776191449.339827:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1768
00000100:00100000:0.0:1776191449.339830:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ea296a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630918848:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191449.340575:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c634116b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630919104:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191449.340613:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191449.345064:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000001330234 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630918976:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191449.345197:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191449.345241:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1776191449.345247:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000455a3f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630919040:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191449.345273:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191449.345306:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630919104
00000100:00100000:1.0:1776191449.345345:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630918976
00000100:00100000:1.0:1776191449.345365:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4710
00000100:00100000:1.0:1776191449.345370:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000074a2729b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630919104:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191449.345556:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000074a2729b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630919104:12345-0@lo:400:kworker/u8:2.0 Request processed in 184us (4942us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191449.345783:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4710
00000100:00100000:1.0:1776191449.345905:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4711
00000100:00100000:1.0:1776191449.345910:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096b9f269 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630918976:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191449.345948:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096b9f269 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630918976:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (752us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191449.345954:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4711
00000100:00100000:1.0:1776191449.346002:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000001330234 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630918976:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191449.346071:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630919040
00000100:00100000:1.0:1776191449.346106:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3207
00000100:00100000:1.0:1776191449.346113:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009501226 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630919040:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191449.346153:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009501226 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630919040:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (880us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191449.346279:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3207
00000100:00100000:1.0:1776191449.346310:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000455a3f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630919040:0@lo:400:kworker/u8:2.0
00000100:00080000:2.0:1776191449.354442:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191449.354451:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191449.354455:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191449.354464:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3982
00000100:00100000:1.0:1776191449.354465:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030eda894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630919168:0@lo:400:kworker/u8:2.0
00000100:00080000:2.0:1776191449.354467:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191449.354477:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191449.354501:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000007f0579a1 x1862467630919232/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191449.354522:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191449.354525:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191449.354527:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191449.354530:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3982
00000100:00080000:2.0:1776191449.354532:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191449.354537:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191449.354539:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191449.354551:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000128cb0b2 x1862467630919296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191449.354595:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f0579a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630919232:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191449.354624:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191449.354711:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ea296a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630918848:12345-0@lo:400:kworker/u8:2.0 Request processed in 14878us (15308us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191449.354723:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1768
00000100:00100000:3.0:1776191449.354881:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000042aec8a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630918848:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191449.355569:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c634116b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630919104:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191449.362148:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630919168
00000100:00100000:2.0:1776191449.362201:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3208
00000100:00100000:2.0:1776191449.362207:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090a9e988 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630919168:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191449.362291:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090a9e988 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630919168:12345-0@lo:400:kworker/u8:2.0 Request processed in 83us (7756us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191449.362299:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3208
00000100:00100000:2.0:1776191449.362419:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000001330234 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630919424:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191449.362457:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191449.362482:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1776191449.362488:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000455a3f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630919360:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191449.362507:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191449.362583:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030eda894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630919168:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191449.363413:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630919424
00000100:00100000:2.0:1776191449.363455:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630919360
00000100:00100000:2.0:1776191449.363476:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4712
00000100:00100000:2.0:1776191449.363481:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c634116b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630919424:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191449.363537:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c634116b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630919424:12345-0@lo:400:kworker/u8:2.0 Request processed in 55us (1080us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191449.363543:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4712
00000100:00100000:2.0:1776191449.363555:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4713
00000100:00100000:2.0:1776191449.363558:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000042aec8a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630919360:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191449.363643:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000042aec8a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630919360:12345-0@lo:400:kworker/u8:2.0 Request processed in 83us (1135us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191449.363649:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4713
00000100:00100000:2.0:1776191449.363683:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000455a3f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630919360:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191449.363694:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000001330234 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630919424:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191449.365214:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630919296:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191449.365274:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191449.365339:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630919232
00000100:00100000:1.0:1776191449.365368:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630919296
00000100:00100000:1.0:1776191449.365383:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2338
00000100:00100000:1.0:1776191449.365387:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000417ffd59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630919232:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191449.365460:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2339
00000100:00100000:2.0:1776191449.365465:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000fc0c826 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630919296:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191449.365765:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191449.365835:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000fc0c826 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630919296:12345-0@lo:8:kworker/u8:2.0 Request processed in 369us (562us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191449.365843:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2339
00010000:02020000:1.0:1776191449.366562:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191449.366606:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000417ffd59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630919232:12345-0@lo:8:kworker/u8:2.0 Request processed in 1217us (11982us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191449.366615:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2338
00000100:00080000:1.0:1776191449.366658:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191449.366662:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191449.366666:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f0579a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630919232:0@lo:8:kworker/u8:2.0
00000100:00080000:1.0:1776191449.366676:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191449.366678:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191449.366680:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630919296:0@lo:8:kworker/u8:2.0
00010000:00010000:3.0:1776191450.107257:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191450.970855:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191450.970911:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191450.970941:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191450.970981:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191450.971005:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191450.971064:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613801216
00000100:00100000:1.0:1776191450.971100:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613801152
00000100:00100000:1.0:1776191450.971133:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2044
00000100:00100000:1.0:1776191450.971140:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e95242b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613801152:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191450.971210:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e95242b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613801152:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 70us (204us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191450.971217:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2044
00000100:00100000:1.0:1776191450.971235:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2340
00000100:00100000:1.0:1776191450.971239:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a133ee9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613801216:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:1.0:1776191450.971344:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191450.971372:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a133ee9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613801216:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 132us (525us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191450.971379:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2340
00000100:00100000:3.0:1776191450.971458:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613801088
00000100:00100000:3.0:1776191450.971491:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613801024
00000100:00100000:3.0:1776191450.971510:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4714
00000100:00100000:3.0:1776191450.971515:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000420c4393 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613801088:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191450.971544:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000420c4393 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613801088:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 29us (604us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191450.971550:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4714
00000100:00100000:3.0:1776191450.971563:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4715
00000100:00100000:3.0:1776191450.971566:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df4e5977 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613801024:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191450.971588:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df4e5977 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613801024:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 21us (608us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191450.971594:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4715
00000100:00100000:0.0:1776191450.971781:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613800960
00000100:00100000:0.0:1776191450.971810:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1769
00000100:00100000:0.0:1776191450.971814:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e58aa936 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613800960:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191450.971853:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e58aa936 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613800960:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 37us (942us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191450.971859:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1769
00010000:00010000:3.0:1776191451.130479:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191452.154538:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191452.410518:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191452.410541:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000001330234 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630919488:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191452.410608:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191452.410792:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630919488
00000100:00100000:2.0:1776191452.410903:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3209
00000100:00100000:2.0:1776191452.410911:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003824609a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630919488:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191452.410944:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191452.410996:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003824609a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630919488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (387us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191452.411003:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3209
00000100:00100000:0.0:1776191452.411073:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000001330234 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630919488:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191453.179861:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191453.438966:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d4261939 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630919552:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191453.439052:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191453.439129:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630919552
00000100:00100000:2.0:1776191453.439183:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3210
00000100:00100000:2.0:1776191453.439188:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093500675 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630919552:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191453.439219:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191453.439486:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093500675 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630919552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 296us (434us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191453.439493:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3210
00000100:00100000:1.0:1776191453.441121:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d4261939 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630919552:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191454.210677:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191454.458329:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191454.458352:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d4261939 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630919616:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191454.458439:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191454.458781:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630919616
00000100:00100000:1.0:1776191454.458831:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1619
00000100:00100000:1.0:1776191454.458837:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f93569a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630919616:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191454.458867:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191454.458911:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f93569a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630919616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (473us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191454.458918:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1619
00000100:00100000:0.0:1776191454.459011:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d4261939 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630919616:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1776191454.460545:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191454.460552:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191454.460555:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191454.460561:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3987
00000100:00080000:0.0:1776191454.460564:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191454.460571:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191454.460588:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000000be03407 x1862467630920064/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191454.460600:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191454.460603:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191454.460604:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191454.460607:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3987
00000100:00080000:0.0:1776191454.460608:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00100000:2.0:1776191454.460722:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ce69651 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630919872:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191454.460776:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1776191454.460787:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191454.460803:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000004d13a9eb x1862467630920128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191454.460805:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:2.0:1776191454.460810:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6387b57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630919680:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191454.460837:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630919808:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191454.460838:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191454.460850:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001eba58d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630919936:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191454.460863:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191454.460881:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4d9e8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630920192:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191454.460881:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630919872
00000100:00100000:0.0:1776191454.460899:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191454.460913:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:0.0:1776191454.460918:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f3626cf8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630919744:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191454.460938:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191454.460950:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000747c5bef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630920000:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191454.460968:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191454.460993:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630920192
00000100:00100000:0.0:1776191454.461016:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630919744
00000100:00100000:2.0:1776191454.461094:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4716
00000100:00100000:2.0:1776191454.461100:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000455a3f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630919872:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191454.461148:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000455a3f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630919872:12345-0@lo:400:kworker/u8:2.0 Request processed in 48us (373us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191454.461155:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4716
00000100:00100000:2.0:1776191454.461172:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4717
00000100:00100000:2.0:1776191454.461175:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c7feddca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630920192:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191454.461332:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c7feddca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630920192:12345-0@lo:400:kworker/u8:2.0 Request processed in 154us (431us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191454.461339:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4717
00000100:00100000:3.0:1776191454.461442:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630919680
00000100:00100000:3.0:1776191454.461480:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1770
00000100:00100000:3.0:1776191454.461485:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae4705ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630919680:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191454.461490:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4718
00000100:00100000:2.0:1776191454.461495:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000511913a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630919744:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191454.461518:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000511913a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630919744:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (580us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191454.461519:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae4705ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630919680:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (682us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191454.461524:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1770
00000100:00100000:1.0:1776191454.461571:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630919808
00000100:00100000:1.0:1776191454.461597:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3211
00000100:00100000:1.0:1776191454.461600:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004905ea34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630919808:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191454.461644:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004905ea34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630919808:12345-0@lo:400:kworker/u8:2.0 Request processed in 43us (781us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191454.461649:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3211
00000100:00100000:1.0:1776191454.461668:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000be03407 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630920064:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191454.461704:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191454.461720:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d13a9eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630920128:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191454.461738:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191454.461780:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630920000
00000100:00100000:1.0:1776191454.461802:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630920064
00000100:00100000:1.0:1776191454.461813:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630920128
00000100:00100000:1.0:1776191454.461825:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2045
00000100:00100000:1.0:1776191454.461828:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019dcd236 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630920000:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191454.461856:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019dcd236 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630920000:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (887us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191454.461861:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2045
00000100:00100000:1.0:1776191454.461871:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2341
00000100:00100000:1.0:1776191454.461874:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000498c5046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630920064:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:1.0:1776191454.461965:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191454.461996:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000498c5046 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630920064:12345-0@lo:8:kworker/u8:2.0 Request processed in 121us (292us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191454.462002:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2341
00000100:00100000:1.0:1776191454.462140:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2342
00000100:00100000:1.0:1776191454.462144:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc6c4887 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630920128:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:1.0:1776191454.462227:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191454.462252:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc6c4887 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630920128:12345-0@lo:8:kworker/u8:2.0 Request processed in 107us (513us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191454.462258:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2342
00000100:00080000:1.0:1776191454.462303:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191454.462307:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191454.462311:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000be03407 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630920064:0@lo:8:kworker/u8:2.0
00000100:00080000:1.0:1776191454.462320:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191454.462323:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191454.462325:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d13a9eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630920128:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191454.462451:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191454.462477:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ce69651 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630919872:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191454.462494:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000af122859 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630920256:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191454.462520:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191454.462539:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6387b57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630919680:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191454.462552:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1776191454.462557:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a11d504 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630920320:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191454.462579:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191454.462603:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630920256
00000100:00100000:3.0:1776191454.463188:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f3626cf8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630919744:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191454.463199:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000747c5bef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630920000:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191454.463208:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630919808:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191454.463217:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4d9e8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630920192:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191454.463253:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630920320
00000100:00100000:3.0:1776191454.463279:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1620
00000100:00100000:3.0:1776191454.463282:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a133ee9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630920320:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191454.463299:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191454.463336:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a133ee9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630920320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (757us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191454.463342:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1620
00000100:00100000:3.0:1776191454.463366:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630919936
00000100:00100000:3.0:1776191454.463384:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3212
00000100:00100000:3.0:1776191454.463387:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000fc0c826 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630919936:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191454.463417:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000fc0c826 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630919936:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (966us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191454.463423:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3212
00000100:00100000:3.0:1776191454.463464:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a11d504 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630920320:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191454.463475:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001eba58d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630919936:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191454.471028:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4718
00000100:00100000:1.0:1776191454.471112:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4719
00000100:00100000:1.0:1776191454.471122:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e95242b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630920256:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191454.471316:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e95242b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630920256:12345-0@lo:400:kworker/u8:2.0 Request processed in 196us (8795us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191454.471324:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4719
00000100:00100000:3.0:1776191454.471769:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000af122859 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630920256:0@lo:400:kworker/u8:2.0
00010000:00010000:3.0:1776191455.228102:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191456.094730:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191456.094782:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191456.094895:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613801536
00000100:00100000:2.0:1776191456.094949:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2343
00000100:00100000:2.0:1776191456.094956:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a4473266 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613801536:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:2.0:1776191456.095093:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191456.095150:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a4473266 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613801536:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 193us (428us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191456.095157:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2343
00000100:00100000:1.0:1776191456.096369:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191456.096402:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191456.096434:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191456.096524:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613801408
00000100:00100000:3.0:1776191456.096569:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613801344
00000100:00100000:3.0:1776191456.096589:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4720
00000100:00100000:3.0:1776191456.096594:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001bf0800d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613801408:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191456.096663:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001bf0800d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613801408:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 68us (298us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191456.096671:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4720
00000100:00100000:3.0:1776191456.096686:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4721
00000100:00100000:3.0:1776191456.096690:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000078e9fbbf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613801344:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191456.096713:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000078e9fbbf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613801344:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 23us (312us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191456.096719:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4721
00000100:00100000:3.0:1776191456.096741:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613801472
00000100:00100000:3.0:1776191456.096764:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2046
00000100:00100000:3.0:1776191456.096767:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c31912e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613801472:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191456.096794:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c31912e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613801472:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 26us (361us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191456.096800:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2046
00000100:00100000:0.0:1776191456.099135:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613801280
00000100:00100000:0.0:1776191456.099306:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1771
00000100:00100000:0.0:1776191456.099314:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000deab4b38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613801280:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191456.099415:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000deab4b38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613801280:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 101us (4633us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191456.099422:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1771
00010000:00010000:3.0:1776191456.251661:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191457.275001:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191457.530287:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191457.530305:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030eda894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630920384:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191457.530382:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191457.530526:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630920384
00000100:00100000:1.0:1776191457.530588:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3213
00000100:00100000:1.0:1776191457.530594:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b044802b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630920384:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191457.530638:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191457.530694:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b044802b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630920384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (313us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191457.530701:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3213
00000100:00100000:0.0:1776191457.530914:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030eda894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630920384:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191458.298414:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191458.554205:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776191458.554224:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005783e1b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630920448:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191458.554296:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191458.556784:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630920448
00000100:00100000:1.0:1776191458.556862:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3214
00000100:00100000:1.0:1776191458.556870:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d71ef7e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630920448:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191458.556909:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191458.556993:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d71ef7e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630920448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (2697us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191458.557000:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3214
00000100:00100000:0.0:1776191458.557679:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005783e1b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630920448:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191459.322648:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1776191459.578362:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191459.578368:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191459.578372:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191459.578379:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3992
00000100:00080000:1.0:1776191459.578383:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191459.578388:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191459.578410:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000023fa1c0 x1862467630921024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191459.578426:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191459.578429:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191459.578431:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191459.578434:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3992
00000100:00080000:1.0:1776191459.578435:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191459.578438:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191459.578452:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000ff726a53 x1862467630921088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191459.578482:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000081285d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630920576:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191459.578483:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000023fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630921024:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191459.578560:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000939da0e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630920640:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191459.578649:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000096ba125a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630920512:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191459.583534:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191459.583589:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ff726a53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630921088:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191459.583623:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191459.583673:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191459.583699:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000985966cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630920832:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191459.583731:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006902fc14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630920704:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191459.583760:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191459.583778:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000872736d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630920960:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191459.583796:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191459.583814:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191459.583820:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a01c31a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630921280:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191459.583827:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191459.583851:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191459.583853:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d4261939 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630921216:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191459.583887:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191459.583891:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630921024
00000100:00100000:2.0:1776191459.583928:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630920704
00000100:00100000:1.0:1776191459.583929:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630921088
00000100:00100000:1.0:1776191459.583951:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630920960
00000100:00100000:2.0:1776191459.583966:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630920832
00000100:00100000:1.0:1776191459.583982:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2047
00000100:00100000:2.0:1776191459.583987:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3215
00000100:00100000:1.0:1776191459.583990:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a102519 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630920960:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191459.583994:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000023dd469f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630920704:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191459.584080:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a102519 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630920960:12345-0@lo:400:kworker/u8:4.0 Request processed in 91us (283us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191459.584088:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2047
00000100:00100000:1.0:1776191459.584105:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2344
00000100:00100000:1.0:1776191459.584109:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000365abfb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630921024:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191459.584205:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191459.584238:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000365abfb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630921024:12345-0@lo:8:kworker/u8:4.0 Request processed in 128us (711us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191459.584245:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2344
00000100:00100000:1.0:1776191459.584257:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2345
00000100:00100000:1.0:1776191459.584260:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d908df0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630921088:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191459.584359:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191459.584384:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d908df0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630921088:12345-0@lo:8:kworker/u8:4.0 Request processed in 123us (762us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191459.584393:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2345
00000100:00100000:1.0:1776191459.584411:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630921280
00000100:00100000:1.0:1776191459.584435:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1621
00000100:00100000:1.0:1776191459.584439:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d1c8a441 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630921280:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191459.584462:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191459.584491:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d1c8a441 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630921280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (642us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191459.584510:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1621
00000100:00100000:1.0:1776191459.584556:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a01c31a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630921280:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191459.584566:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000872736d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630920960:0@lo:400:kworker/u8:4.0
00000100:00080000:1.0:1776191459.584607:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191459.584611:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191459.584614:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000023fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630921024:0@lo:8:kworker/u8:4.0
00000100:00080000:1.0:1776191459.584622:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191459.584625:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191459.584627:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ff726a53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630921088:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191459.584658:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3216
00000100:00100000:1.0:1776191459.584663:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030eda894 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630920832:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191459.584700:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030eda894 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630920832:12345-0@lo:400:kworker/u8:4.0 Request processed in 36us (874us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191459.584706:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3216
00000100:00100000:1.0:1776191459.584748:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630920576
00000100:00100000:1.0:1776191459.584770:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1772
00000100:00100000:1.0:1776191459.584774:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a4afbcc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630920576:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191459.584802:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a4afbcc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630920576:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (1131us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191459.584808:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1772
00000100:00100000:1.0:1776191459.584851:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630921216
00000100:00100000:1.0:1776191459.584874:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4722
00000100:00100000:1.0:1776191459.584877:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000001330234 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630921216:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191459.584907:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000001330234 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630921216:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (1021us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191459.584913:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4722
00000100:00100000:1.0:1776191459.584946:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000081285d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630920576:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191459.584955:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000985966cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630920832:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191459.584966:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d4261939 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630921216:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191459.584995:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000023dd469f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630920704:12345-0@lo:400:kworker/u8:4.0 Request processed in 1000us (1233us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191459.585005:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006902fc14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630920704:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191459.585017:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3215
00000100:00100000:0.0:1776191459.590642:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191459.590684:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cd188b2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630920896:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191459.590720:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191459.590846:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630920640
00000100:00100000:2.0:1776191459.590846:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630920896
00000100:00100000:2.0:1776191459.590894:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2048
00000100:00100000:1.0:1776191459.590899:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4723
00000100:00100000:2.0:1776191459.590903:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af122859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630920896:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191459.590907:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000002f18e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630920640:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191459.591027:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000939da0e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630920640:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191459.591071:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cd188b2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630920896:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191459.592922:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000002f18e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630920640:12345-0@lo:400:kworker/u8:4.0 Request processed in 2011us (2282us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191459.592938:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4723
00000100:00100000:2.0:1776191459.593449:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af122859 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630920896:12345-0@lo:400:kworker/u8:4.0 Request processed in 2545us (2726us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191459.593460:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2048
00000100:00100000:3.0:1776191459.593483:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191459.593628:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec5453aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630920768:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191459.593667:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191459.593694:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005783e1b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630921152:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191459.593716:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191459.593819:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630920768
00000100:00100000:0.0:1776191459.593854:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630921152
00000100:00100000:0.0:1776191459.593872:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4724
00000100:00100000:0.0:1776191459.593878:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a471b42d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630920768:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191459.593930:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a471b42d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630920768:12345-0@lo:400:kworker/u8:4.0 Request processed in 51us (263us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191459.593939:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4724
00000100:00100000:0.0:1776191459.593950:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4725
00000100:00100000:0.0:1776191459.593954:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b9ded24d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630921152:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191459.593981:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b9ded24d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630921152:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (265us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191459.593985:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4725
00000100:00100000:3.0:1776191459.594102:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec5453aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630920768:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191459.594112:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005783e1b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630921152:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191459.594601:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630920512
00000100:00100000:1.0:1776191459.594677:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1622
00000100:00100000:1.0:1776191459.594680:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a11d504 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630920512:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191459.594701:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191459.594751:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a11d504 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630920512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (1270us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191459.594757:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1622
00000100:00100000:3.0:1776191459.594819:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000096ba125a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630920512:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1776191460.346302:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191461.214716:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191461.214878:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191461.214920:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191461.214947:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191461.215020:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613801856
00000100:00100000:3.0:1776191461.215099:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2346
00000100:00100000:3.0:1776191461.215105:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005783e1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613801856:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:3.0:1776191461.215208:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191461.215276:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005783e1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613801856:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 170us (399us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191461.215283:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2346
00000100:00100000:0.0:1776191461.215640:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613801600
00000100:00100000:0.0:1776191461.215679:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1773
00000100:00100000:0.0:1776191461.215684:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dbba1dca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613801600:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191461.215727:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dbba1dca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613801600:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 42us (808us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191461.215733:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1773
00000100:00100000:2.0:1776191461.218839:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613801664
00000100:00100000:3.0:1776191461.218942:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613801728
00000100:00100000:3.0:1776191461.219121:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4726
00000100:00100000:3.0:1776191461.219129:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a01c31a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613801664:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191461.219224:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a01c31a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613801664:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 95us (4515us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191461.219232:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4726
00000100:00100000:3.0:1776191461.219254:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4727
00000100:00100000:3.0:1776191461.219259:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ec5453aa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613801728:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191461.219288:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ec5453aa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613801728:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 29us (4341us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191461.219293:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4727
00000100:00100000:1.0:1776191461.220947:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191461.221195:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613801792
00000100:00100000:2.0:1776191461.221442:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2049
00000100:00100000:2.0:1776191461.221449:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd188b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613801792:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191461.221529:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd188b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613801792:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 80us (590us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191461.221562:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2049
00010000:00010000:3.0:1776191461.370698:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191462.394354:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191462.650568:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630921344:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191462.650636:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191462.650725:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630921344
00000100:00100000:3.0:1776191462.650773:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3217
00000100:00100000:3.0:1776191462.650778:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000939da0e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630921344:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191462.650813:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191462.650862:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000939da0e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630921344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (227us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191462.650869:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3217
00000100:00100000:2.0:1776191462.650993:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630921344:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191463.418546:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191463.675541:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006902fc14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630921408:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191463.675608:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191463.675703:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630921408
00000100:00100000:1.0:1776191463.675751:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3218
00000100:00100000:1.0:1776191463.675757:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000023d9198f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630921408:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191463.675788:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191463.675839:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000023d9198f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630921408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (231us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191463.675846:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3218
00000100:00100000:0.0:1776191463.675960:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006902fc14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630921408:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191464.442413:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191464.698750:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be32aae2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630921536:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191464.698771:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d4261939 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630921472:0@lo:13:osp-pre-0-0.0
00000100:00080000:0.0:1776191464.698959:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191464.698964:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191464.698968:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191464.698972:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3997
00000100:00080000:0.0:1776191464.698974:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191464.698980:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191464.698996:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000000be03407 x1862467630922048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191464.699013:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191464.699016:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191464.699018:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191464.699020:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 3997
00000100:00080000:0.0:1776191464.699022:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191464.699025:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191464.699051:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000019dcd236 x1862467630922112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191464.699099:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000be03407 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630922048:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191464.700332:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4d9e8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630921664:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191464.701938:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191464.702096:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630921728:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191464.702577:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191464.702658:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d13a9eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630921984:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191464.702683:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191464.702725:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001eba58d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630921600:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191464.702754:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191464.702770:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f3626cf8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630921856:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191464.702789:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191464.702810:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000056503154 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630922240:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191464.702835:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191464.702909:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:2.0:1776191464.702916:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000747c5bef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630921792:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191464.702939:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191464.702955:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000096ba125a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630922176:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191464.702974:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191464.703111:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630921984
00000100:00100000:2.0:1776191464.703164:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2050
00000100:00100000:2.0:1776191464.703170:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f5f736f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630921984:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191464.703220:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f5f736f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630921984:12345-0@lo:400:kworker/u8:2.0 Request processed in 49us (536us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191464.703228:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2050
00000100:00100000:2.0:1776191464.703253:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630921600
00000100:00100000:2.0:1776191464.703673:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1774
00000100:00100000:3.0:1776191464.703678:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191464.703682:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b9375c8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630921600:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191464.703718:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630921728
00000100:00100000:2.0:1776191464.703727:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b9375c8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630921600:12345-0@lo:400:kworker/u8:2.0 Request processed in 46us (972us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191464.703734:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1774
00000100:00100000:3.0:1776191464.703750:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630921856
00000100:00100000:2.0:1776191464.703770:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3219
00000100:00100000:2.0:1776191464.703775:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f0579a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630921728:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191464.703823:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191464.703824:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191464.703827:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f0579a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630921728:12345-0@lo:400:kworker/u8:2.0 Request processed in 49us (1250us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191464.703835:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3219
00000100:00100000:0.0:1776191464.703849:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000019dcd236 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630922112:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191464.703849:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ce69651 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630921920:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191464.703873:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191464.703882:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3220
00000100:00100000:1.0:1776191464.703887:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdd224e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630921856:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191464.703921:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630922240
00000100:00100000:1.0:1776191464.703922:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdd224e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630921856:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (1132us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191464.703935:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630922048
00000100:00100000:2.0:1776191464.703950:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630921792
00000100:00100000:0.0:1776191464.703973:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630922112
00000100:00100000:2.0:1776191464.703973:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4728
00000100:00100000:2.0:1776191464.703979:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008629d0f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630922240:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191464.703996:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2347
00000100:00100000:0.0:1776191464.704001:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000069339e29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630922048:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191464.704022:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008629d0f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630922240:12345-0@lo:400:kworker/u8:2.0 Request processed in 42us (1186us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191464.704030:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4728
00000100:00100000:2.0:1776191464.704061:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630922176
00000100:00100000:2.0:1776191464.704080:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630921664
00000100:00100000:2.0:1776191464.704091:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4729
00000100:00100000:2.0:1776191464.704094:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003e233a3c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630921792:12345-0@lo:400:kworker/u8:2.0
00010000:02020000:0.0:1776191464.704126:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191464.704133:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003e233a3c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630921792:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (1193us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191464.704142:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4729
00000100:00100000:2.0:1776191464.704166:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4730
00000100:00100000:2.0:1776191464.704170:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000057cc3d6f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630922176:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191464.704175:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000069339e29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630922048:12345-0@lo:8:kworker/u8:2.0 Request processed in 170us (351us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191464.704183:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2347
00000100:00100000:0.0:1776191464.704198:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2348
00000100:00100000:0.0:1776191464.704202:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000f2c1983 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630922112:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191464.704207:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000057cc3d6f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630922176:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (1232us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191464.704214:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4730
00000100:00100000:2.0:1776191464.704225:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4731
00000100:00100000:2.0:1776191464.704229:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000985966cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630921664:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191464.704251:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000985966cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630921664:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (439us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191464.704259:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4731
00000100:00100000:1.0:1776191464.704280:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3220
00010000:02020000:0.0:1776191464.704282:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191464.704307:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000f2c1983 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630922112:12345-0@lo:8:kworker/u8:2.0 Request processed in 105us (435us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191464.704308:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191464.704313:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2348
00000100:00100000:0.0:1776191464.704322:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630921920
00000100:00100000:0.0:1776191464.704339:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2051
00000100:00100000:0.0:1776191464.704342:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000081285d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630921920:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191464.704342:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4d9e8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630921664:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191464.704368:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000081285d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630921920:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (60us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191464.704373:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2051
00000100:00100000:1.0:1776191464.704375:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ce69651 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630921920:0@lo:400:kworker/u8:2.0
00000100:00080000:0.0:1776191464.704396:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191464.704400:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191464.704404:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000be03407 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630922048:0@lo:8:kworker/u8:2.0
00000100:00080000:0.0:1776191464.704411:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191464.704414:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191464.704416:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000019dcd236 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630922112:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191464.704449:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000747c5bef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630921792:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191464.704469:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000096ba125a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630922176:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191464.704478:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001eba58d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630921600:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191464.704487:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f3626cf8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630921856:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191464.704496:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000056503154 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630922240:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191464.704537:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630921728:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191464.704551:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d13a9eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630921984:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191464.706409:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630921472
00000100:00100000:0.0:1776191464.709813:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630921536
00000100:00100000:1.0:1776191464.711533:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1623
00000100:00100000:1.0:1776191464.711545:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000128cb0b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630921472:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191464.711584:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191464.711672:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000128cb0b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630921472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (9740us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191464.711680:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1623
00000100:00100000:2.0:1776191464.711721:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d4261939 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630921472:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191464.712366:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1624
00000100:00100000:0.0:1776191464.712372:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000522261df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630921536:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191464.712391:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191464.712439:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000522261df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630921536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (8766us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191464.712445:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1624
00000100:00100000:2.0:1776191464.712597:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be32aae2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630921536:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1776191465.466274:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191466.330256:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191466.330596:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613802176
00000100:00100000:3.0:1776191466.330650:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2349
00000100:00100000:3.0:1776191466.330657:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e56d17f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613802176:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:3.0:1776191466.330760:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191466.330829:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e56d17f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613802176:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 171us (580us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191466.330836:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2349
00000100:00100000:1.0:1776191466.335173:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191466.335215:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191466.335251:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191466.335285:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191466.335374:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613801920
00000100:00100000:3.0:1776191466.335438:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1775
00000100:00100000:3.0:1776191466.335445:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fec76140 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613801920:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191466.335516:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fec76140 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613801920:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 71us (264us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191466.335528:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1775
00000100:00100000:2.0:1776191466.335609:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613801984
00000100:00100000:2.0:1776191466.335646:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613802048
00000100:00100000:2.0:1776191466.335673:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4732
00000100:00100000:2.0:1776191466.335677:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ff726a53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613801984:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191466.335712:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ff726a53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613801984:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 34us (546us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191466.335717:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4732
00000100:00100000:2.0:1776191466.335729:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4733
00000100:00100000:2.0:1776191466.335732:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000872736d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613802048:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191466.335755:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000872736d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613802048:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 22us (471us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191466.335761:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4733
00000100:00100000:0.0:1776191466.336207:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613802112
00000100:00100000:0.0:1776191466.336245:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2052
00000100:00100000:0.0:1776191466.336250:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000023fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613802112:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191466.336302:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000023fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613802112:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 50us (1086us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191466.336310:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2052
00010000:00010000:3.0:1776191466.490552:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191467.514600:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191467.770573:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191467.770606:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001bc0bbec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630922304:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191467.770671:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191467.770841:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630922304
00000100:00100000:2.0:1776191467.770897:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3221
00000100:00100000:2.0:1776191467.770903:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000056503154 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630922304:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191467.770935:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191467.770986:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000056503154 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630922304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (316us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191467.770992:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3221
00000100:00100000:0.0:1776191467.771271:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001bc0bbec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630922304:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191468.542917:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191468.794509:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1776191468.794524:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d4261939 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630922368:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191468.794591:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191468.795013:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630922368
00000100:00100000:3.0:1776191468.795105:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3222
00000100:00100000:3.0:1776191468.795111:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000911fdeb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630922368:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191468.795143:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191468.795202:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000911fdeb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630922368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (611us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191468.795209:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3222
00000100:00100000:1.0:1776191468.795428:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d4261939 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630922368:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191469.562464:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191469.818220:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000070c80d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630922432:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191469.818289:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191469.818336:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630922432
00000100:00100000:2.0:1776191469.818400:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1625
00000100:00100000:2.0:1776191469.818406:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cfc3317d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630922432:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191469.818435:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191469.818479:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cfc3317d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630922432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (190us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191469.818500:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1625
00000100:00100000:3.0:1776191469.818678:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e8472586 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630922496:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191469.818712:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191469.818748:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630922496
00000100:00100000:0.0:1776191469.818798:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000070c80d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630922432:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191469.818880:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1626
00000100:00100000:3.0:1776191469.818887:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ed05c09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630922496:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191469.819128:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00080000:1.0:1776191469.819468:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191469.819473:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191469.819476:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191469.819480:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4002
00000100:00080000:1.0:1776191469.819482:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191469.819487:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191469.819504:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000001eba58d4 x1862467630922880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191469.819522:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191469.819524:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191469.819526:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191469.819528:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4002
00000100:00080000:1.0:1776191469.819530:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191469.819533:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191469.819542:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000096ba125a x1862467630922944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191469.819578:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d4261939 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630922560:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191469.819602:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ed05c09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630922496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 713us (889us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191469.819655:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001eba58d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630922880:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191469.819683:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191469.819711:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630922880
00000100:00100000:0.0:1776191469.819735:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2350
00000100:00100000:0.0:1776191469.819739:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000005638afb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630922880:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191469.819835:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191469.819864:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000005638afb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630922880:12345-0@lo:8:kworker/u8:4.0 Request processed in 123us (180us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191469.819871:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2350
00000100:00100000:0.0:1776191469.819907:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000096ba125a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630922944:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191469.819930:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191469.819952:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630922944
00000100:00100000:0.0:1776191469.819967:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2351
00000100:00100000:0.0:1776191469.819971:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e61c6045 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630922944:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191469.820074:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191469.820099:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e61c6045 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630922944:12345-0@lo:8:kworker/u8:4.0 Request processed in 127us (169us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191469.820105:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2351
00000100:00080000:0.0:1776191469.820131:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191469.820135:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191469.820138:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001eba58d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630922880:0@lo:8:kworker/u8:4.0
00000100:00080000:0.0:1776191469.820146:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191469.820148:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191469.820150:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000096ba125a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630922944:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191469.820255:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006902fc14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630922624:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191469.820288:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191469.820307:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000747c5bef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630923008:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191469.820327:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191469.820366:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630922624
00000100:00100000:1.0:1776191469.820431:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191469.820817:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630923008
00000100:00100000:0.0:1776191469.820845:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4734
00000100:00100000:0.0:1776191469.820849:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000055821921 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630922624:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191469.820895:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000055821921 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630922624:12345-0@lo:400:kworker/u8:4.0 Request processed in 44us (607us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191469.820900:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4734
00000100:00100000:0.0:1776191469.820912:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4735
00000100:00100000:0.0:1776191469.820915:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008711709e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630923008:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191469.820940:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008711709e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630923008:12345-0@lo:400:kworker/u8:4.0 Request processed in 24us (613us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191469.820945:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4735
00000100:00100000:0.0:1776191469.820974:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006902fc14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630922624:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191469.820983:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000747c5bef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630923008:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191469.821014:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d13a9eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630922688:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191469.821060:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191469.821077:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000019dcd236 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630923072:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191469.821099:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191469.821120:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776191469.821125:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630922752:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191469.821146:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191469.821167:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630923072
00000100:00100000:0.0:1776191469.821188:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630922752
00000100:00100000:0.0:1776191469.821203:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4736
00000100:00100000:0.0:1776191469.821206:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ac87280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630923072:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191469.821235:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ac87280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630923072:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (136us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191469.821241:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4736
00000100:00100000:0.0:1776191469.821252:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4737
00000100:00100000:0.0:1776191469.821255:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008890c810 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630922752:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191469.821279:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008890c810 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630922752:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (133us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191469.821284:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4737
00000100:00100000:0.0:1776191469.821306:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630922752:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191469.821316:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000019dcd236 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630923072:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191469.821387:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630922688
00000100:00100000:0.0:1776191469.821412:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3223
00000100:00100000:0.0:1776191469.821417:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003570f9a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630922688:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191469.821449:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003570f9a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630922688:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (389us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191469.821455:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3223
00000100:00100000:0.0:1776191469.821476:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d13a9eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630922688:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191469.821518:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e8472586 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630922496:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191469.824710:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f3626cf8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630922816:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191469.824775:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191469.824854:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630922560
00000100:00100000:1.0:1776191469.824901:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1776
00000100:00100000:1.0:1776191469.824907:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cdaa8581 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630922560:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191469.824955:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cdaa8581 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630922560:12345-0@lo:400:kworker/u8:4.0 Request processed in 48us (4524us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191469.824962:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1776
00000100:00100000:0.0:1776191469.825088:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630922816
00000100:00100000:0.0:1776191469.825116:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3224
00000100:00100000:0.0:1776191469.825120:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000be03407 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630922816:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191469.825154:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000be03407 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630922816:12345-0@lo:400:kworker/u8:4.0 Request processed in 33us (380us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191469.825160:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3224
00000100:00100000:1.0:1776191469.825295:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d4261939 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630922560:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191469.825305:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f3626cf8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630922816:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191469.826155:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1626
00010000:00010000:3.0:1776191470.589511:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191471.453783:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191471.453965:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191471.454080:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613802240
00000100:00100000:2.0:1776191471.454139:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1777
00000100:00100000:2.0:1776191471.454146:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009803db2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613802240:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191471.454227:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009803db2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613802240:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 80us (451us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191471.454237:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1777
00000100:00100000:3.0:1776191471.454369:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613802304
00000100:00100000:3.0:1776191471.454409:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4738
00000100:00100000:3.0:1776191471.454413:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f3626cf8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613802304:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191471.454448:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f3626cf8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613802304:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 34us (483us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191471.454453:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4738
00000100:00100000:2.0:1776191471.454922:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191471.454989:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191471.455321:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613802368
00000100:00100000:3.0:1776191471.455355:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4739
00000100:00100000:3.0:1776191471.455359:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070c80d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613802368:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191471.455402:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070c80d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613802368:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 42us (482us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191471.455408:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4739
00000100:00100000:1.0:1776191471.455610:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613802432
00000100:00100000:1.0:1776191471.455644:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2053
00000100:00100000:1.0:1776191471.455649:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001bc0bbec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613802432:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191471.455685:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001bc0bbec pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613802432:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 36us (697us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191471.455691:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2053
00000100:00100000:0.0:1776191471.471532:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191471.471734:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613802496
00000100:00100000:2.0:1776191471.472029:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2352
00000100:00100000:2.0:1776191471.472062:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ecc8f95b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613802496:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:2.0:1776191471.472166:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191471.472346:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ecc8f95b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613802496:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 283us (821us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191471.472354:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2352
00010000:00010000:3.0:1776191471.617002:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191472.634338:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191472.890966:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191472.890986:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009189961c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630923136:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191472.891075:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191472.891198:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630923136
00000100:00100000:2.0:1776191472.891245:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3225
00000100:00100000:2.0:1776191472.891251:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ce69651 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630923136:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191472.891291:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191472.891341:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ce69651 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630923136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (266us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191472.891348:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3225
00000100:00100000:1.0:1776191472.891460:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009189961c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630923136:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191473.658503:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191473.915549:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4d9e8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630923200:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191473.915624:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191473.915887:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630923200
00000100:00100000:3.0:1776191473.915936:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3226
00000100:00100000:3.0:1776191473.915941:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009df06d88 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630923200:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191473.915973:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191473.916029:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009df06d88 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630923200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (405us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191473.916070:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3226
00000100:00100000:0.0:1776191473.916232:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4d9e8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630923200:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191474.683081:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191474.938187:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191474.938203:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5f06cb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630923328:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1776191474.938221:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191474.938226:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191474.938230:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1776191474.938232:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4d9e8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630923264:0@lo:400:kworker/u8:4.0
00000100:00080000:1.0:1776191474.938252:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4007
00000100:00080000:1.0:1776191474.938256:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191474.938262:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191474.938282:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000007f5a166e x1862467630923776/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191474.938296:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191474.938299:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191474.938301:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191474.938303:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4007
00000100:00080000:1.0:1776191474.938305:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191474.938308:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191474.938317:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000b92c4097 x1862467630923840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191474.938353:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000019dcd236 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630923456:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191474.938363:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000747c5bef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630923584:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191474.944444:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191474.944492:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630923520:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191474.944528:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191474.944559:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000150035b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630923904:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191474.944584:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191474.944635:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630923264
00000100:00100000:3.0:1776191474.944677:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1778
00000100:00100000:3.0:1776191474.944682:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000364ff3a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630923264:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191474.944739:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000364ff3a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630923264:12345-0@lo:400:kworker/u8:4.0 Request processed in 57us (304us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191474.944746:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1778
00000100:00100000:3.0:1776191474.944778:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630923520
00000100:00100000:3.0:1776191474.944802:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630923904
00000100:00100000:3.0:1776191474.944821:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4740
00000100:00100000:3.0:1776191474.944825:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f3676dee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630923520:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191474.944857:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f3676dee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630923520:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (328us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191474.944862:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4740
00000100:00100000:3.0:1776191474.944872:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4741
00000100:00100000:3.0:1776191474.944875:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008363769b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630923904:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191474.944896:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008363769b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630923904:12345-0@lo:400:kworker/u8:4.0 Request processed in 20us (312us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191474.944901:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4741
00000100:00100000:3.0:1776191474.944957:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000150035b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630923904:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191474.944966:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4d9e8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630923264:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191474.944974:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630923520:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191474.945028:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f5a166e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630923776:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191474.945077:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191474.945094:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b92c4097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630923840:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191474.945113:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191474.945139:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630923776
00000100:00100000:3.0:1776191474.945157:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630923840
00000100:00100000:3.0:1776191474.945172:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2353
00000100:00100000:3.0:1776191474.945175:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d858fae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630923776:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191474.945283:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191474.945317:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d858fae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630923776:12345-0@lo:8:kworker/u8:4.0 Request processed in 140us (239us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191474.945323:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2353
00000100:00100000:3.0:1776191474.945333:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2354
00000100:00100000:3.0:1776191474.945335:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c3a79bd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630923840:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191474.945416:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191474.945438:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c3a79bd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630923840:12345-0@lo:8:kworker/u8:4.0 Request processed in 101us (325us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191474.945444:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2354
00000100:00080000:3.0:1776191474.945476:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191474.945481:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191474.945484:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f5a166e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630923776:0@lo:8:kworker/u8:4.0
00000100:00080000:3.0:1776191474.945490:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191474.945493:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191474.945495:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b92c4097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630923840:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191474.953114:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191474.953205:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630923456
00000100:00100000:3.0:1776191474.953271:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3227
00000100:00100000:3.0:1776191474.953277:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000259772a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630923456:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191474.953371:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191474.953396:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630923584
00000100:00100000:2.0:1776191474.953420:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3228
00000100:00100000:2.0:1776191474.953423:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000161dca59 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630923584:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191474.953454:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000161dca59 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630923584:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (85us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191474.953461:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3228
00000100:00100000:2.0:1776191474.953488:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005be56c88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630923968:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191474.953515:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191474.953559:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630923968
00000100:00100000:2.0:1776191474.953605:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4742
00000100:00100000:2.0:1776191474.953608:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a26e20f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630923968:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191474.953636:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a26e20f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630923968:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (120us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191474.953641:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4742
00000100:00100000:2.0:1776191474.953674:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000747c5bef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630923584:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191474.953684:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005be56c88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630923968:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191474.953701:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [1->0]
00000100:00100000:2.0:1776191474.953707:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d13a9eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630923392:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191474.953728:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191474.953746:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630923392
00000100:00100000:2.0:1776191474.953766:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4743
00000100:00100000:2.0:1776191474.953769:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c82d865 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630923392:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191474.953795:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c82d865 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630923392:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (67us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191474.953800:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4743
00000100:00100000:2.0:1776191474.953817:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000096ba125a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630923648:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191474.953841:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191474.953863:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630923648
00000100:00100000:2.0:1776191474.953891:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2054
00000100:00100000:2.0:1776191474.953895:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007c94492b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630923648:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191474.953922:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007c94492b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630923648:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (81us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191474.953927:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2054
00000100:00100000:2.0:1776191474.953943:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630924032:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191474.953966:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191474.953987:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d13a9eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630923392:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191474.953995:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000096ba125a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630923648:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191474.954065:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630924032
00000100:00100000:2.0:1776191474.954089:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1627
00000100:00100000:2.0:1776191474.954093:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009189961c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630924032:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191474.954112:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191474.954141:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009189961c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630924032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (175us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191474.954147:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1627
00000100:00100000:2.0:1776191474.954176:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630924032:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191474.964288:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001eba58d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630923712:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191474.964371:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191474.964684:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191474.964821:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000259772a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630923456:12345-0@lo:400:kworker/u8:4.0 Request processed in 11542us (11713us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191474.964833:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3227
00000100:00100000:0.0:1776191474.964907:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000019dcd236 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630923456:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191474.967826:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630923712
00000100:00100000:2.0:1776191474.967895:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2055
00000100:00100000:2.0:1776191474.967902:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3e12bd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630923712:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191474.968098:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3e12bd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630923712:12345-0@lo:400:kworker/u8:4.0 Request processed in 195us (3728us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191474.968107:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2055
00000100:00100000:0.0:1776191474.968147:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001eba58d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630923712:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191474.968278:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630923328
00000100:00100000:1.0:1776191474.968316:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1628
00000100:00100000:1.0:1776191474.968320:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c200fc57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630923328:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191474.968336:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191474.968429:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5f06cb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630923328:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191474.968521:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c200fc57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630923328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 199us (3838us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191474.968528:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1628
00010000:00010000:3.0:1776191475.706251:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191476.575120:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191476.575212:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613802560
00000100:00100000:0.0:1776191476.575267:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1779
00000100:00100000:0.0:1776191476.575273:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ea43294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613802560:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191476.575351:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ea43294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613802560:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 76us (238us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191476.575359:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1779
00000100:00100000:3.0:1776191476.577188:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191476.577294:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613802624
00000100:00100000:2.0:1776191476.577520:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4744
00000100:00100000:2.0:1776191476.577527:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000141d33cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613802624:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191476.577599:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000141d33cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613802624:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 71us (416us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191476.577607:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4744
00000100:00100000:2.0:1776191476.588179:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191476.588239:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191476.588274:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191476.588464:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613802688
00000100:00100000:0.0:1776191476.588526:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4745
00000100:00100000:0.0:1776191476.588533:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048199cde pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613802688:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191476.588603:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048199cde pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613802688:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 70us (364us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191476.588611:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4745
00000100:00100000:1.0:1776191476.589346:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613802752
00000100:00100000:1.0:1776191476.589390:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613802816
00000100:00100000:1.0:1776191476.589410:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2056
00000100:00100000:1.0:1776191476.589415:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ec42a12f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613802752:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191476.589456:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ec42a12f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613802752:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 40us (1286us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191476.589463:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2056
00000100:00100000:1.0:1776191476.589478:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2355
00000100:00100000:1.0:1776191476.589481:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba29c9bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613802816:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:1.0:1776191476.589647:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191476.589676:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba29c9bf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613802816:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 193us (1402us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191476.589683:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2355
00010000:00010000:3.0:1776191476.732319:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191477.754224:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191478.010817:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000016f04c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630924096:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191478.010884:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191478.010992:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630924096
00000100:00100000:3.0:1776191478.011069:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3229
00000100:00100000:3.0:1776191478.011075:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003f51e2bd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630924096:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191478.011109:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191478.017286:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003f51e2bd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630924096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6204us (6396us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191478.017297:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000016f04c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630924096:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191478.017305:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3229
00010000:00010000:3.0:1776191478.778552:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191479.038241:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007416a516 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630924160:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191479.038314:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191479.038462:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630924160
00000100:00100000:0.0:1776191479.038513:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3230
00000100:00100000:0.0:1776191479.038519:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000098ff6e13 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630924160:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191479.038552:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191479.039779:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000098ff6e13 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630924160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1254us (1462us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191479.039790:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3230
00000100:00100000:3.0:1776191479.050639:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007416a516 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630924160:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191479.802869:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191480.058210:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023bc758a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630924224:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191480.058279:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191480.058308:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776191480.058313:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000852fcdad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630924288:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191480.058335:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1776191480.058653:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191480.058658:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191480.058662:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191480.058666:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4013
00000100:00080000:0.0:1776191480.058669:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191480.058674:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191480.058693:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000019361fa9 x1862467630924672/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191480.058709:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191480.058712:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191480.058713:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191480.058716:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4013
00000100:00080000:0.0:1776191480.058718:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191480.058721:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191480.058742:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000079eea346 x1862467630924736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191480.058774:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a48cc882 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630924544:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191480.058806:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191480.058825:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:0.0:1776191480.058830:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c2f2cb97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630924480:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191480.058853:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191480.058866:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006902fc14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630924864:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191480.058883:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191480.058909:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630924544
00000100:00100000:0.0:1776191480.058945:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630924864
00000100:00100000:0.0:1776191480.058966:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4746
00000100:00100000:0.0:1776191480.058973:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000c78be5c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630924544:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191480.059023:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000c78be5c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630924544:12345-0@lo:400:kworker/u8:2.0 Request processed in 49us (215us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191480.059029:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4746
00000100:00100000:0.0:1776191480.059064:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4747
00000100:00100000:0.0:1776191480.059068:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f4a0d93 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630924864:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191480.059094:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f4a0d93 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630924864:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (210us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191480.059100:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4747
00000100:00100000:0.0:1776191480.059149:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006902fc14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630924864:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191480.059160:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a48cc882 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630924544:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191480.059202:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630924480
00000100:00100000:0.0:1776191480.059223:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3231
00000100:00100000:0.0:1776191480.059226:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef1632e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630924480:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191480.059266:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef1632e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630924480:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (413us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191480.059272:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3231
00000100:00100000:0.0:1776191480.059293:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c2f2cb97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630924480:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191480.059329:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000019361fa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630924672:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191480.059355:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191480.059369:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000079eea346 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630924736:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191480.059387:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191480.059409:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007c618fbc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630924416:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191480.059426:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191480.059437:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d4261939 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630924800:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191480.059455:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191480.059467:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:0.0:1776191480.059471:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a18fdc4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630924352:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191480.059494:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191480.059506:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f739a423 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630924608:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191480.059523:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191480.059543:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630924416
00000100:00100000:0.0:1776191480.059564:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630924800
00000100:00100000:0.0:1776191480.059579:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4748
00000100:00100000:0.0:1776191480.059583:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd493bd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630924416:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191480.059613:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd493bd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630924416:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (187us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191480.059619:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4748
00000100:00100000:0.0:1776191480.059629:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4749
00000100:00100000:0.0:1776191480.059633:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006bbd87df pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630924800:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191480.059656:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006bbd87df pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630924800:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (201us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191480.059664:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4749
00000100:00100000:0.0:1776191480.059686:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630924608
00000100:00100000:0.0:1776191480.059704:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3232
00000100:00100000:0.0:1776191480.059707:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bce8a16d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630924608:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191480.059871:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630924672
00000100:00100000:2.0:1776191480.059894:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630924736
00000100:00100000:2.0:1776191480.059908:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2356
00000100:00100000:2.0:1776191480.059911:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009916a1d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630924672:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191480.059999:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191480.060053:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009916a1d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630924672:12345-0@lo:8:kworker/u8:2.0 Request processed in 140us (698us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191480.060059:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2356
00000100:00100000:2.0:1776191480.060071:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2357
00000100:00100000:2.0:1776191480.060074:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029b0687d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630924736:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191480.060166:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191480.060190:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029b0687d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630924736:12345-0@lo:8:kworker/u8:2.0 Request processed in 115us (802us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191480.060196:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2357
00000100:00100000:2.0:1776191480.060237:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630924352
00000100:00100000:2.0:1776191480.060260:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1780
00000100:00100000:2.0:1776191480.060264:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d186bef1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630924352:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191480.060292:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d186bef1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630924352:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (797us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191480.060297:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1780
00000100:00100000:2.0:1776191480.060343:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a18fdc4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630924352:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191480.060354:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f739a423 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630924608:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191480.060363:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007c618fbc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630924416:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191480.060370:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d4261939 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630924800:0@lo:400:kworker/u8:2.0
00000100:00080000:2.0:1776191480.060411:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191480.060415:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191480.060418:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000019361fa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630924672:0@lo:8:kworker/u8:2.0
00000100:00080000:2.0:1776191480.060426:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191480.060429:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191480.060431:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000079eea346 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630924736:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191480.060470:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bce8a16d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630924608:12345-0@lo:400:kworker/u8:2.0 Request processed in 760us (945us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191480.060477:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3232
00000100:00100000:3.0:1776191480.062212:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630924224
00000100:00100000:3.0:1776191480.062258:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630924288
00000100:00100000:3.0:1776191480.062330:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1629
00000100:00100000:3.0:1776191480.062336:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000552b8f18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630924224:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191480.062367:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191480.062446:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000552b8f18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630924224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (4150us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191480.062455:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1629
00000100:00100000:3.0:1776191480.062471:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1630
00000100:00100000:3.0:1776191480.062475:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016f04c4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630924288:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191480.062487:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191480.062512:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016f04c4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630924288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (4176us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191480.062518:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1630
00000100:00100000:0.0:1776191480.062745:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000852fcdad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630924288:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191480.062771:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023bc758a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630924224:0@lo:13:osp-pre-0-0.0
00010000:00010000:3.0:1776191480.828147:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191481.697310:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191481.697380:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191481.697407:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191481.697460:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191481.697461:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613802944
00000100:00100000:1.0:1776191481.697495:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191481.697557:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613803136
00000100:00100000:0.0:1776191481.697590:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613803072
00000100:00100000:0.0:1776191481.697612:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2057
00000100:00100000:0.0:1776191481.697618:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c6976d8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613803072:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191481.697682:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c6976d8f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613803072:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 63us (276us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191481.697690:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2057
00000100:00100000:0.0:1776191481.697710:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2358
00000100:00100000:0.0:1776191481.697714:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a31b7ec8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613803136:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00000100:00100000:1.0:1776191481.697753:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613802880
00000100:00100000:1.0:1776191481.697786:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1781
00000100:00100000:1.0:1776191481.697801:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000050bd026a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613802880:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00010000:02020000:0.0:1776191481.697809:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191481.697843:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000050bd026a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613802880:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 40us (382us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191481.697850:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1781
00000100:00100000:3.0:1776191481.698316:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613803008
00000100:00100000:1.0:1776191481.698327:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4750
00000100:00100000:1.0:1776191481.698336:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e3e4ab4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613802944:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191481.698353:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4751
00000100:00100000:3.0:1776191481.698359:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f78d80e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613803008:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191481.699594:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a31b7ec8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613803136:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 1874us (2293us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191481.699607:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2358
00000100:00100000:3.0:1776191481.702531:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f78d80e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613803008:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 4161us (5027us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191481.702551:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4751
00000100:00100000:0.0:1776191481.702838:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e3e4ab4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613802944:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 4501us (5456us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191481.702847:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4750
00010000:00010000:3.0:1776191481.850361:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191482.875547:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191483.130720:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191483.130736:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023bc758a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630924928:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191483.130798:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191483.132625:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630924928
00000100:00100000:3.0:1776191483.132695:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3233
00000100:00100000:3.0:1776191483.132701:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005fd6c919 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630924928:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191483.132735:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191483.133005:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005fd6c919 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630924928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 303us (2207us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191483.133013:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3233
00000100:00100000:1.0:1776191483.133100:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023bc758a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630924928:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191483.898275:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191484.154412:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003117df42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630924992:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191484.154486:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191484.155585:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630924992
00000100:00100000:3.0:1776191484.155652:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3234
00000100:00100000:3.0:1776191484.155659:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000023bc758a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630924992:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191484.155707:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191484.155777:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000023bc758a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630924992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (1292us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191484.155784:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3234
00000100:00100000:0.0:1776191484.155946:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003117df42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630924992:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191484.922228:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1776191485.179174:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191485.179182:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191485.179185:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191485.179193:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4018
00000100:00080000:0.0:1776191485.179197:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191485.179202:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191485.179222:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000085501c10 x1862467630925504/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191485.179236:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191485.179238:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191485.179240:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191485.179242:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4018
00000100:00080000:0.0:1776191485.179243:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191485.179246:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191485.179254:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000009e7f18ac x1862467630925568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191485.179293:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000012ee9fc3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630925184:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191485.179357:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191485.179386:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000087d2fc09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630925440:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191485.179422:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191485.179446:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:0.0:1776191485.179451:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008dbfa9ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630925120:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191485.179475:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191485.179490:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea373370 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630925376:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191485.179512:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191485.179546:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630925440
00000100:00100000:0.0:1776191485.179588:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630925376
00000100:00100000:0.0:1776191485.179606:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2058
00000100:00100000:0.0:1776191485.179611:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007c618fbc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630925440:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191485.179680:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007c618fbc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630925440:12345-0@lo:400:kworker/u8:2.0 Request processed in 68us (257us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191485.179687:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2058
00000100:00100000:0.0:1776191485.179703:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2059
00000100:00100000:0.0:1776191485.179706:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a18fdc4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630925376:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191485.179734:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a18fdc4f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630925376:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (221us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191485.179740:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2059
00000100:00100000:0.0:1776191485.179772:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630925120
00000100:00100000:0.0:1776191485.179795:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4752
00000100:00100000:0.0:1776191485.179799:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f739a423 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630925120:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191485.179828:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f739a423 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630925120:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (352us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191485.179833:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4752
00000100:00100000:0.0:1776191485.179859:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630925184
00000100:00100000:0.0:1776191485.179879:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3235
00000100:00100000:0.0:1776191485.179883:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019361fa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630925184:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191485.179909:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019361fa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630925184:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (553us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191485.179914:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3235
00000100:00100000:0.0:1776191485.179932:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c7f8b512 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630925056:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191485.179960:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191485.179974:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d0c84519 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630925312:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191485.179993:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191485.180007:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000079eea346 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630925696:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191485.180062:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191485.180078:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:0.0:1776191485.180084:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9a725e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630925248:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191485.180106:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191485.180119:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030c9704c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630925632:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191485.180141:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191485.180167:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630925696
00000100:00100000:0.0:1776191485.180191:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630925248
00000100:00100000:0.0:1776191485.180205:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630925632
00000100:00100000:0.0:1776191485.180221:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4753
00000100:00100000:0.0:1776191485.180225:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a48cc882 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630925696:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191485.180257:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a48cc882 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630925696:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (195us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191485.180263:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4753
00000100:00100000:0.0:1776191485.180273:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4754
00000100:00100000:0.0:1776191485.180277:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d4261939 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630925248:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191485.180301:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d4261939 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630925248:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (195us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191485.180309:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4754
00000100:00100000:0.0:1776191485.180321:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4755
00000100:00100000:0.0:1776191485.180324:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006902fc14 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630925632:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191485.180347:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006902fc14 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630925632:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (210us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191485.180352:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4755
00000100:00100000:0.0:1776191485.180381:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630925312
00000100:00100000:0.0:1776191485.180398:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3236
00000100:00100000:0.0:1776191485.180401:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c2f2cb97 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630925312:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191485.180426:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c2f2cb97 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630925312:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (432us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191485.180431:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3236
00000100:00100000:0.0:1776191485.180465:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9a725e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630925248:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191485.180475:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030c9704c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630925632:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191485.180482:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0c84519 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630925312:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191485.180489:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000079eea346 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630925696:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191485.180523:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008dbfa9ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630925120:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191485.180531:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea373370 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630925376:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191485.180538:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000012ee9fc3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630925184:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191485.180545:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000087d2fc09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630925440:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191485.180680:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085501c10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630925504:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191485.180708:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191485.180722:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009e7f18ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630925568:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191485.180739:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191485.180763:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630925504
00000100:00100000:2.0:1776191485.180780:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630925568
00000100:00100000:2.0:1776191485.180792:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2359
00000100:00100000:2.0:1776191485.180795:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000086a13048 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630925504:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191485.180888:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191485.180919:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000086a13048 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630925504:12345-0@lo:8:kworker/u8:2.0 Request processed in 123us (211us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191485.180925:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2359
00000100:00100000:2.0:1776191485.180937:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2360
00000100:00100000:2.0:1776191485.180940:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000043c46f30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630925568:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191485.181060:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191485.181081:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000043c46f30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630925568:12345-0@lo:8:kworker/u8:2.0 Request processed in 140us (342us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191485.181087:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2360
00000100:00080000:2.0:1776191485.181116:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191485.181119:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191485.181122:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085501c10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630925504:0@lo:8:kworker/u8:2.0
00000100:00080000:2.0:1776191485.181130:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191485.181132:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191485.181134:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009e7f18ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630925568:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191485.181153:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1776191485.181160:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d60a5454 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630925760:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191485.181184:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191485.181207:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630925760
00000100:00100000:2.0:1776191485.181228:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1631
00000100:00100000:2.0:1776191485.181232:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aaba3ebf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630925760:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191485.181252:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191485.181282:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aaba3ebf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630925760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (99us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191485.181289:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1631
00000100:00100000:2.0:1776191485.181314:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d60a5454 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630925760:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191485.181905:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191485.181913:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057916d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630925824:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191485.181936:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191485.181968:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630925056
00000100:00100000:1.0:1776191485.181988:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1782
00000100:00100000:1.0:1776191485.181990:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008cbd400d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630925056:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191485.182013:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008cbd400d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630925056:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (2053us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191485.182054:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1782
00000100:00100000:1.0:1776191485.182084:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630925824
00000100:00100000:1.0:1776191485.182105:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1632
00000100:00100000:1.0:1776191485.182109:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000020539371 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630925824:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191485.182120:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191485.182516:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000020539371 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630925824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (212us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191485.182522:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1632
00000100:00100000:1.0:1776191485.182555:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057916d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630925824:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191485.182846:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c7f8b512 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630925056:0@lo:400:kworker/u8:2.0
00010000:00010000:0.0:1776191485.947704:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191486.810402:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191486.810447:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191486.810471:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191486.810510:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191486.810549:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613803392
00000100:00100000:1.0:1776191486.810596:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2060
00000100:00100000:1.0:1776191486.810603:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ad77ca4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613803392:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191486.810675:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ad77ca4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613803392:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 71us (168us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191486.810683:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2060
00000100:00100000:3.0:1776191486.810705:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613803264
00000100:00100000:3.0:1776191486.810739:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613803328
00000100:00100000:1.0:1776191486.810748:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191486.810765:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4756
00000100:00100000:3.0:1776191486.810771:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a09685a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613803264:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191486.810806:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a09685a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613803264:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 33us (358us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191486.810813:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4756
00000100:00100000:3.0:1776191486.810830:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4757
00000100:00100000:3.0:1776191486.810835:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000551629ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613803328:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191486.810836:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613803456
00000100:00100000:1.0:1776191486.810859:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2361
00000100:00100000:1.0:1776191486.810863:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d6586537 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613803456:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00000100:00100000:3.0:1776191486.810873:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000551629ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613803328:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 36us (401us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191486.810880:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4757
00010000:02020000:1.0:1776191486.810957:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191486.811117:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613803200
00000100:00100000:0.0:1776191486.811155:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1783
00000100:00100000:0.0:1776191486.811159:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000afc79a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613803200:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191486.811203:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000afc79a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613803200:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 43us (810us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191486.811209:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1783
00000100:00100000:1.0:1776191486.812125:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d6586537 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613803456:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 1258us (1375us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191486.812135:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2361
00010000:00010000:3.0:1776191486.970275:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191487.994759:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191488.250551:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d60a5454 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630925888:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191488.250612:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191488.250693:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630925888
00000100:00100000:1.0:1776191488.250734:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3237
00000100:00100000:1.0:1776191488.250739:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f50805c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630925888:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191488.250768:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191488.250808:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f50805c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630925888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (196us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191488.250815:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3237
00000100:00100000:3.0:1776191488.250931:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d60a5454 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630925888:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191489.031078:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191489.274314:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005624ae51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630925952:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191489.274381:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191489.274485:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630925952
00000100:00100000:0.0:1776191489.274535:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3238
00000100:00100000:0.0:1776191489.274542:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000baaea16f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630925952:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191489.274574:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191489.274625:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000baaea16f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630925952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (245us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191489.274632:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3238
00000100:00100000:3.0:1776191489.274772:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005624ae51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630925952:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191490.042635:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191490.299289:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a0c5ca5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630926016:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191490.299444:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad5119bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630926080:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191490.299505:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191490.299643:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191490.299676:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5f06cb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630926272:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191490.299701:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191490.299734:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630926080
00000100:00100000:1.0:1776191490.299773:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630926016
00000100:00100000:1.0:1776191490.299793:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1633
00000100:00100000:1.0:1776191490.299799:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000079eea346 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630926080:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191490.299842:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191490.314459:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630926272
00000100:00100000:2.0:1776191490.314529:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3239
00000100:00100000:2.0:1776191490.314537:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000039ed90c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630926272:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191490.314632:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000039ed90c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630926272:12345-0@lo:400:kworker/u8:2.0 Request processed in 95us (14931us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191490.314639:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3239
00000100:00100000:2.0:1776191490.315316:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1634
00000100:00100000:2.0:1776191490.315324:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7d5fc38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630926016:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191490.315344:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00080000:3.0:1776191490.315366:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191490.315372:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191490.315375:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191490.315381:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4023
00000100:00080000:3.0:1776191490.315384:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191490.315389:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191490.315392:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7d5fc38 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630926016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (15747us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191490.315400:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1634
00000100:00100000:3.0:1776191490.315411:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000020784d50 x1862467630926464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191490.315429:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000852fcdad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630926208:0@lo:400:kworker/u8:2.0
00000100:00080000:3.0:1776191490.315432:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191490.315436:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191490.315438:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191490.315441:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4023
00000100:00080000:3.0:1776191490.315442:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191490.315445:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191490.315456:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000039f9568 x1862467630926528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191490.315486:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191490.315508:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000020784d50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630926464:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191490.315518:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b92c4097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630926592:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191490.315546:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191490.315566:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000039f9568 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630926528:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191490.315567:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191490.315596:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:2.0:1776191490.315604:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057916d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630926144:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191490.315633:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191490.315659:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be32aae2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630926400:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191490.315680:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191490.315717:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630926208
00000100:00100000:2.0:1776191490.315746:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630926592
00000100:00100000:2.0:1776191490.315768:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4758
00000100:00100000:2.0:1776191490.315772:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049ac3e3f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630926208:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191490.315779:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000079eea346 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630926080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 15976us (16270us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191490.315788:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1633
00000100:00100000:1.0:1776191490.315818:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630926400
00000100:00100000:2.0:1776191490.315821:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049ac3e3f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630926208:12345-0@lo:400:kworker/u8:2.0 Request processed in 46us (337us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191490.315828:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4758
00000100:00100000:2.0:1776191490.315843:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4759
00000100:00100000:2.0:1776191490.315846:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090d0fdf2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630926592:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191490.315871:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090d0fdf2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630926592:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (320us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191490.315876:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4759
00000100:00100000:2.0:1776191490.315919:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b92c4097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630926592:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191490.315931:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000852fcdad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630926208:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191490.315969:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630926464
00000100:00100000:2.0:1776191490.315988:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2362
00000100:00100000:2.0:1776191490.315991:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001eba58d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630926464:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191490.316397:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191490.316405:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191490.316475:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3240
00000100:00100000:1.0:1776191490.316479:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d31571c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630926400:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191490.317139:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001eba58d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630926464:12345-0@lo:8:kworker/u8:2.0 Request processed in 1145us (1592us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191490.317148:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2362
00000100:00100000:2.0:1776191490.317165:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630926528
00000100:00100000:2.0:1776191490.317185:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2363
00000100:00100000:2.0:1776191490.317188:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019dcd236 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630926528:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191490.317285:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191490.317310:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019dcd236 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630926528:12345-0@lo:8:kworker/u8:2.0 Request processed in 121us (1716us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191490.317316:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2363
00000100:00100000:2.0:1776191490.317378:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630926144
00000100:00100000:2.0:1776191490.317408:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1784
00000100:00100000:2.0:1776191490.317412:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003026b1b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630926144:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191490.317459:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003026b1b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630926144:12345-0@lo:400:kworker/u8:2.0 Request processed in 46us (1826us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191490.317465:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1784
00000100:00100000:2.0:1776191490.317501:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f5a166e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630926656:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191490.317528:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191490.318097:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad5119bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630926080:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191490.318132:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630926656
00000100:00100000:0.0:1776191490.318158:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4760
00000100:00100000:0.0:1776191490.318162:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f5a341cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630926656:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191490.318195:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f5a341cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630926656:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (667us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191490.318201:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4760
00000100:00100000:0.0:1776191490.318220:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e8472586 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630926336:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191490.318245:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191490.318267:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630926336
00000100:00100000:0.0:1776191490.318287:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4761
00000100:00100000:0.0:1776191490.318291:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c7f8b512 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630926336:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191490.318319:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c7f8b512 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630926336:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (75us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191490.318324:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4761
00000100:00100000:0.0:1776191490.318347:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e8472586 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630926336:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191490.318392:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057916d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630926144:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191490.318482:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d31571c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630926400:12345-0@lo:400:kworker/u8:2.0 Request processed in 2001us (2800us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191490.318490:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3240
00000100:00100000:2.0:1776191490.318848:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5f06cb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630926272:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191490.318870:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a0c5ca5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630926016:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191490.318892:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f5a166e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630926656:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191490.319523:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be32aae2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630926400:0@lo:400:kworker/u8:2.0
00000100:00080000:3.0:1776191490.320505:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191490.320511:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191490.320515:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000039f9568 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630926528:0@lo:8:kworker/u8:2.0
00000100:00080000:3.0:1776191490.320538:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191490.320542:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191490.320544:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000020784d50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630926464:0@lo:8:kworker/u8:2.0
00010000:00010000:3.0:1776191491.066876:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191491.941248:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191491.941311:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191491.941362:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191491.941387:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191491.941413:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191491.941459:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613803776
00000100:00100000:2.0:1776191491.941494:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613803712
00000100:00100000:2.0:1776191491.941535:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2061
00000100:00100000:2.0:1776191491.941543:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002b2a0d7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613803712:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191491.941991:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002b2a0d7f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613803712:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 446us (576us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191491.942000:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2061
00000100:00100000:2.0:1776191491.942021:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2364
00000100:00100000:2.0:1776191491.942026:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a0c5ca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613803776:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:2.0:1776191491.942149:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191491.942177:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a0c5ca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613803776:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 150us (938us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191491.942184:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2364
00000100:00100000:0.0:1776191491.943483:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613803648
00000100:00100000:0.0:1776191491.943551:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613803584
00000100:00100000:2.0:1776191491.944168:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4762
00000100:00100000:2.0:1776191491.944176:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b98175e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613803648:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191491.944245:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b98175e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613803648:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 69us (2883us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191491.944253:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4762
00000100:00100000:0.0:1776191491.944339:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4763
00000100:00100000:0.0:1776191491.944344:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027ba4fae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613803584:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191491.944388:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027ba4fae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613803584:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 43us (3000us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191491.944394:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4763
00000100:00100000:1.0:1776191491.946119:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613803520
00000100:00100000:1.0:1776191491.946315:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1785
00000100:00100000:1.0:1776191491.946323:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be2451ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613803520:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191491.946531:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be2451ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613803520:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 208us (5220us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191491.946540:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1785
00010000:00010000:0.0:1776191492.090897:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191493.114783:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191493.371560:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191493.371582:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086a13048 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630926720:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191493.371645:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191493.371759:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630926720
00000100:00100000:2.0:1776191493.371807:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3241
00000100:00100000:2.0:1776191493.371813:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027f5d17c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630926720:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191493.371858:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191493.371915:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027f5d17c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630926720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (270us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191493.371922:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3241
00000100:00100000:3.0:1776191493.372077:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086a13048 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630926720:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191494.138223:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191494.394472:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c95e149a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630926784:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191494.394539:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191494.394620:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630926784
00000100:00100000:2.0:1776191494.394671:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3242
00000100:00100000:2.0:1776191494.394676:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096ba125a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630926784:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191494.394709:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191494.397953:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096ba125a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630926784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3267us (3407us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191494.397970:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3242
00000100:00100000:3.0:1776191494.398698:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c95e149a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630926784:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191495.162321:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191495.418244:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043c46f30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630926848:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191495.418320:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191495.418441:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630926848
00000100:00100000:2.0:1776191495.418489:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1635
00000100:00100000:2.0:1776191495.418495:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009e7f18ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630926848:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191495.418522:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191495.418559:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009e7f18ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630926848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (241us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191495.418566:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1635
00000100:00100000:3.0:1776191495.418675:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a0c5ca5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630926912:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191495.418742:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191495.418761:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191495.418766:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1776191495.418767:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c6976d8f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630927168:0@lo:400:kworker/u8:4.0
00000100:00080000:1.0:1776191495.418770:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191495.418775:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4028
00000100:00080000:1.0:1776191495.418778:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191495.418781:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191495.418812:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000000ad77ca4 x1862467630927296/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191495.418821:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191495.418834:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191495.418838:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191495.418839:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1776191495.418841:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00080000:1.0:1776191495.418845:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4028
00000100:00080000:1.0:1776191495.418847:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00100000:3.0:1776191495.418848:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000070835139 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630926976:0@lo:400:kworker/u8:4.0
00000100:00080000:1.0:1776191495.418852:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191495.418867:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000d6586537 x1862467630927360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191495.418885:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191495.418903:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a31b7ec8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630927232:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191495.418916:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ad77ca4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630927296:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191495.418929:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191495.418959:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630926976
00000100:00100000:1.0:1776191495.418963:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191495.418984:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6586537 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630927360:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191495.418991:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1786
00000100:00100000:3.0:1776191495.418996:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f9c8ab18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630926976:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191495.419008:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191495.419066:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630926912
00000100:00100000:1.0:1776191495.419089:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1636
00000100:00100000:1.0:1776191495.419093:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004d13a9eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630926912:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191495.419105:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191495.419163:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e3e12bd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630927104:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191495.419228:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630927296
00000100:00100000:2.0:1776191495.419253:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630927360
00000100:00100000:2.0:1776191495.419282:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2365
00000100:00100000:2.0:1776191495.419286:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007416a516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630927296:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191495.419383:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191495.421449:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004d13a9eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630926912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2348us (2702us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191495.421462:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1636
00000100:00100000:1.0:1776191495.421539:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630927168
00000100:00100000:1.0:1776191495.421573:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4764
00000100:00100000:1.0:1776191495.421577:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000747c5bef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630927168:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191495.421616:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000747c5bef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630927168:12345-0@lo:400:kworker/u8:4.0 Request processed in 39us (2800us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191495.421622:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4764
00000100:00100000:1.0:1776191495.421664:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2366
00000100:00100000:1.0:1776191495.421668:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005be56c88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630927360:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191495.421805:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191495.421834:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005be56c88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630927360:12345-0@lo:8:kworker/u8:4.0 Request processed in 165us (2828us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191495.421840:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2366
00000100:00100000:1.0:1776191495.421858:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630927232
00000100:00100000:1.0:1776191495.421877:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3243
00000100:00100000:1.0:1776191495.421880:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a8e91aa5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630927232:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191495.421904:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a8e91aa5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630927232:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (2977us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191495.421908:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3243
00000100:00080000:1.0:1776191495.421937:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191495.421940:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191495.421943:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6586537 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630927360:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191495.421971:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000070835139 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630926976:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191495.421980:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a31b7ec8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630927232:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191495.421988:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c6976d8f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630927168:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191495.422000:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a0c5ca5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630926912:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191495.422060:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c95e149a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630927040:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191495.422089:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191495.422103:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005624ae51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630927424:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191495.422120:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191495.422142:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630927040
00000100:00100000:1.0:1776191495.422158:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630927424
00000100:00100000:1.0:1776191495.422171:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4765
00000100:00100000:1.0:1776191495.422175:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c6976d8f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630927040:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191495.422200:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c6976d8f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630927040:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (112us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191495.422206:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4765
00000100:00100000:1.0:1776191495.422214:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4766
00000100:00100000:1.0:1776191495.422217:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a31b7ec8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630927424:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191495.422235:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a31b7ec8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630927424:12345-0@lo:400:kworker/u8:4.0 Request processed in 17us (115us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191495.422239:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4766
00000100:00100000:1.0:1776191495.422256:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c95e149a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630927040:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191495.422276:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005624ae51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630927424:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191495.423128:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191495.423162:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003117df42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630927488:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191495.423191:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191495.423227:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000043c46f30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630926848:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191495.423410:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630927488
00000100:00100000:0.0:1776191495.423445:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4767
00000100:00100000:0.0:1776191495.423450:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000087d2fc09 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630927488:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191495.423493:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000087d2fc09 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630927488:12345-0@lo:400:kworker/u8:4.0 Request processed in 42us (301us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191495.423508:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4767
00000100:00100000:0.0:1776191495.423535:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003117df42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630927488:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191495.423635:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630927104
00000100:00100000:3.0:1776191495.423646:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f9c8ab18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630926976:12345-0@lo:400:kworker/u8:4.0 Request processed in 4646us (4761us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191495.423656:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1786
00000100:00100000:1.0:1776191495.423664:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3244
00000100:00100000:1.0:1776191495.423670:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085501c10 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630927104:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191495.423709:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085501c10 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630927104:12345-0@lo:400:kworker/u8:4.0 Request processed in 38us (582us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191495.423717:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3244
00000100:00100000:3.0:1776191495.423736:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e3e12bd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630927104:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191495.423919:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007416a516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630927296:12345-0@lo:8:kworker/u8:4.0 Request processed in 4631us (4957us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191495.423927:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2365
00000100:00080000:1.0:1776191495.424202:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191495.424206:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191495.424209:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ad77ca4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630927296:0@lo:8:kworker/u8:4.0
00010000:00010000:3.0:1776191496.195518:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191497.050809:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191497.050852:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191497.050885:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191497.050922:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191497.050958:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191497.050991:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613804032
00000100:00100000:2.0:1776191497.051063:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613804096
00000100:00100000:2.0:1776191497.051082:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2062
00000100:00100000:2.0:1776191497.051088:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000859dbd41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613804032:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191497.051156:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000859dbd41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613804032:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 67us (234us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191497.051163:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2062
00000100:00100000:2.0:1776191497.051180:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2367
00000100:00100000:2.0:1776191497.051184:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000034b88fee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613804096:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:2.0:1776191497.051275:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191497.051302:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000034b88fee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613804096:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 117us (345us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191497.051308:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2367
00000100:00100000:0.0:1776191497.051517:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613803840
00000100:00100000:0.0:1776191497.051545:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1787
00000100:00100000:0.0:1776191497.051548:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081b9520e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613803840:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191497.051575:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081b9520e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613803840:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 26us (774us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191497.051580:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1787
00000100:00100000:1.0:1776191497.051838:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613803904
00000100:00100000:1.0:1776191497.051865:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613803968
00000100:00100000:1.0:1776191497.051883:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4768
00000100:00100000:1.0:1776191497.051887:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000175c7031 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613803904:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191497.051918:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000175c7031 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613803904:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 30us (1067us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191497.051924:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4768
00000100:00100000:1.0:1776191497.051948:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4769
00000100:00100000:1.0:1776191497.051953:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000072a04f94 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613803968:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191497.051975:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000072a04f94 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613803968:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 22us (1090us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191497.051981:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4769
00010000:00010000:3.0:1776191497.210409:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191498.234384:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191498.491802:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191498.491821:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630927552:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191498.491889:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191498.492015:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630927552
00000100:00100000:3.0:1776191498.492068:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3245
00000100:00100000:3.0:1776191498.492073:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000012ee9fc3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630927552:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191498.492101:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191498.492342:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000012ee9fc3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630927552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 268us (453us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191498.492349:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3245
00000100:00100000:0.0:1776191498.492540:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630927552:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191499.258482:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191499.514372:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191499.515031:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ad77ca4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630927616:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191499.515121:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191499.515231:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630927616
00000100:00100000:1.0:1776191499.515324:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3246
00000100:00100000:1.0:1776191499.515331:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a4d9e8c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630927616:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191499.515364:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191499.515422:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a4d9e8c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630927616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (302us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191499.515429:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3246
00000100:00100000:3.0:1776191499.515503:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ad77ca4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630927616:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191500.282268:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191500.538307:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008dbfa9ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630927744:0@lo:400:kworker/u8:2.0
00000100:00080000:0.0:1776191500.538337:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191500.538343:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191500.538346:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191500.538351:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4033
00000100:00080000:0.0:1776191500.538355:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191500.538360:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191500.538379:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000d0e4254d x1862467630928192/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191500.538394:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1776191500.538395:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191500.538400:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191500.538401:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191500.538404:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4033
00000100:00080000:0.0:1776191500.538407:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191500.538410:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191500.538421:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000055f4b7ff x1862467630928256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191500.538438:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009916a1d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630928000:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191500.538460:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030c9704c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630927872:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191500.538469:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191500.538490:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008a2b80b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630928384:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191500.538511:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191500.538524:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191500.538536:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eefb5d99 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630928128:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191500.538544:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [2->3]
00000100:00100000:3.0:1776191500.538553:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea373370 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630927680:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191500.538566:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191500.538584:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191500.538590:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:0.0:1776191500.538598:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d0c84519 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630927808:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191500.538606:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9a725e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630927936:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191500.538627:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191500.538655:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029b0687d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630928064:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191500.538658:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630927744
00000100:00100000:0.0:1776191500.538682:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191500.538715:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1788
00000100:00100000:3.0:1776191500.538723:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b0b64a4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630927744:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191500.538727:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630928000
00000100:00100000:0.0:1776191500.538749:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630927872
00000100:00100000:0.0:1776191500.538767:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3247
00000100:00100000:0.0:1776191500.538770:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af122859 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630928000:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191500.538778:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b0b64a4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630927744:12345-0@lo:400:kworker/u8:2.0 Request processed in 55us (386us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191500.538786:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1788
00000100:00100000:3.0:1776191500.538970:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630928384
00000100:00100000:3.0:1776191500.538997:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630927808
00000100:00100000:3.0:1776191500.539016:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4770
00000100:00100000:3.0:1776191500.539019:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001eba58d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630928384:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191500.539100:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3248
00000100:00100000:1.0:1776191500.539105:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e600ea8b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630927872:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191500.539452:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af122859 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630928000:12345-0@lo:400:kworker/u8:2.0 Request processed in 678us (982us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191500.539460:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3247
00000100:00100000:0.0:1776191500.539499:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630928128
00000100:00100000:0.0:1776191500.539524:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630928064
00000100:00100000:0.0:1776191500.539540:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2063
00000100:00100000:0.0:1776191500.539545:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d9f622e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630928128:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191500.539586:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d9f622e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630928128:12345-0@lo:400:kworker/u8:2.0 Request processed in 41us (1022us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191500.539592:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2063
00000100:00100000:0.0:1776191500.539603:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2064
00000100:00100000:0.0:1776191500.539606:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ff26b50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630928064:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191500.539631:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ff26b50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630928064:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (951us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191500.539636:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2064
00000100:00100000:0.0:1776191500.539652:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4771
00000100:00100000:0.0:1776191500.539656:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bed67ee8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630927808:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191500.539681:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bed67ee8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630927808:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (1056us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191500.539698:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4771
00000100:00100000:0.0:1776191500.539742:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0c84519 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630927808:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191500.539756:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029b0687d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630928064:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191500.539767:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eefb5d99 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630928128:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191500.539799:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630927680
00000100:00100000:0.0:1776191500.539804:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191500.539823:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000155ae841 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630928320:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191500.539842:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1637
00000100:00100000:2.0:1776191500.539848:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019dcd236 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630927680:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191500.539854:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00002000:00000024:2.0:1776191500.539875:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191500.539881:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009916a1d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630928000:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191500.539892:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008dbfa9ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630927744:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191500.539917:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019dcd236 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630927680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (1335us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191500.539921:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea373370 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630927680:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191500.539926:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1637
00000100:00100000:2.0:1776191500.539955:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d0e4254d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630928192:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191500.539983:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191500.540004:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055f4b7ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630928256:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191500.540015:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191500.540026:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009af94ad9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630928448:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191500.540030:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191500.540078:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191500.540083:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630927936
00000100:00100000:0.0:1776191500.540111:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630928448
00000100:00100000:2.0:1776191500.540111:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630928320
00000100:00100000:2.0:1776191500.540142:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4772
00000100:00100000:2.0:1776191500.540150:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eefb5d99 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630927936:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191500.540151:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1638
00000100:00100000:0.0:1776191500.540159:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000caebeb11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630928448:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191500.540173:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191500.540195:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eefb5d99 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630927936:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (391us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191500.540202:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4772
00000100:00100000:0.0:1776191500.540217:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000caebeb11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630928448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (138us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191500.540222:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4773
00000100:00100000:2.0:1776191500.540231:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e9827495 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630928320:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191500.540232:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1638
00000100:00100000:0.0:1776191500.540275:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009af94ad9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630928448:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191500.540275:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e9827495 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630928320:12345-0@lo:400:kworker/u8:2.0 Request processed in 44us (423us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191500.540287:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4773
00000100:00100000:0.0:1776191500.540310:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9a725e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630927936:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191500.540314:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630928192
00000100:00100000:0.0:1776191500.540323:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000155ae841 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630928320:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191500.540334:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630928256
00000100:00100000:2.0:1776191500.540362:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2368
00000100:00100000:2.0:1776191500.540366:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a426c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630928192:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191500.540370:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2369
00000100:00100000:0.0:1776191500.540376:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000939787e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630928256:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191500.540769:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:02020000:2.0:1776191500.540782:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191500.540812:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000939787e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630928256:12345-0@lo:8:kworker/u8:2.0 Request processed in 434us (784us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191500.540819:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a426c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630928192:12345-0@lo:8:kworker/u8:2.0 Request processed in 451us (836us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191500.540822:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2369
00000100:00100000:2.0:1776191500.540831:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2368
00000100:00080000:2.0:1776191500.540864:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191500.540869:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191500.540873:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0e4254d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630928192:0@lo:8:kworker/u8:2.0
00000100:00080000:2.0:1776191500.540883:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191500.540886:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191500.540888:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055f4b7ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630928256:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191500.542476:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001eba58d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630928384:12345-0@lo:400:kworker/u8:2.0 Request processed in 3450us (3949us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191500.542552:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4770
00000100:00100000:1.0:1776191500.542834:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e600ea8b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630927872:12345-0@lo:400:kworker/u8:2.0 Request processed in 3727us (4322us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191500.542842:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3248
00000100:00100000:2.0:1776191500.542906:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030c9704c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630927872:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191500.547715:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008a2b80b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630928384:0@lo:400:kworker/u8:2.0
00010000:00010000:0.0:1776191501.306280:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191502.170567:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191502.170611:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191502.170718:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613804160
00000100:00100000:2.0:1776191502.170780:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1789
00000100:00100000:2.0:1776191502.170788:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085b2d193 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613804160:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191502.170862:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085b2d193 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613804160:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 74us (304us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191502.170870:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1789
00000100:00100000:1.0:1776191502.171082:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191502.172917:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191502.172951:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191502.172998:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613804288
00000100:00100000:0.0:1776191502.173023:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613804224
00000100:00100000:3.0:1776191502.173068:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4774
00000100:00100000:3.0:1776191502.173075:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005624ae51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613804288:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191502.173127:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613804352
00000100:00100000:1.0:1776191502.173151:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613804416
00000100:00100000:1.0:1776191502.173168:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2065
00000100:00100000:1.0:1776191502.173172:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070835139 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613804352:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191502.173242:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2370
00000100:00100000:2.0:1776191502.173246:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d6586537 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613804416:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:2.0:1776191502.173340:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191502.173414:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4775
00000100:00100000:0.0:1776191502.173418:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c95e149a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613804224:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191502.173469:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005624ae51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613804288:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 393us (2857us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191502.173478:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4774
00000100:00100000:1.0:1776191502.173494:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070835139 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613804352:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 320us (582us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191502.173501:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2065
00000100:00100000:2.0:1776191502.173699:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d6586537 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613804416:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 450us (747us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191502.173706:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2370
00000100:00100000:0.0:1776191502.173749:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c95e149a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613804224:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 330us (2668us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191502.173756:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4775
00010000:00010000:3.0:1776191502.330259:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191503.354293:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191503.610394:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191503.610410:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630928512:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191503.610473:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191503.610859:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630928512
00000100:00100000:1.0:1776191503.610917:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3249
00000100:00100000:1.0:1776191503.610923:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b9f58501 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630928512:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191503.610955:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191503.611007:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b9f58501 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630928512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (534us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191503.611013:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3249
00000100:00100000:3.0:1776191503.611114:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630928512:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191504.381766:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191504.634214:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000150035b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630928576:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191504.634285:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191504.636479:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630928576
00000100:00100000:0.0:1776191504.636634:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3250
00000100:00100000:0.0:1776191504.636641:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000551a670c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630928576:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191504.636688:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191504.636774:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000551a670c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630928576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (2489us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191504.636781:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3250
00000100:00100000:3.0:1776191504.636873:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000150035b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630928576:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191505.402520:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191505.658259:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008a2b80b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630928640:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191505.658329:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191505.658389:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630928640
00000100:00080000:1.0:1776191505.658397:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191505.658401:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191505.658404:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191505.658408:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4038
00000100:00080000:1.0:1776191505.658411:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191505.658415:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191505.658429:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000074fc7059 x1862467630929088/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191505.658433:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1639
00000100:00100000:2.0:1776191505.658443:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000043c46f30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630928640:12345-0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1776191505.658445:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191505.658451:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191505.658453:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191505.658455:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4038
00000100:00080000:1.0:1776191505.658456:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191505.658458:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191505.658465:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000004bce44f9 x1862467630929152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00002000:00000024:2.0:1776191505.658478:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191505.658487:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003117df42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630928896:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191505.658525:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000043c46f30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630928640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (196us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191505.658536:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191505.658547:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1639
00000100:00100000:1.0:1776191505.658555:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000cbdfd62 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630929280:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191505.658593:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191505.658625:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008a2b80b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630928640:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191505.658641:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:1.0:1776191505.658646:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e3e12bd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630928832:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191505.658668:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191505.658681:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a6460e87 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630929216:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191505.658681:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000074fc7059 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630929088:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191505.658702:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191505.658726:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191505.658732:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630928896
00000100:00100000:2.0:1776191505.658750:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004bce44f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630929152:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191505.658762:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630929280
00000100:00100000:2.0:1776191505.658777:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191505.658780:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630929216
00000100:00100000:1.0:1776191505.658800:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4776
00000100:00100000:1.0:1776191505.658804:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006de4f7b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630928896:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191505.658836:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630929088
00000100:00100000:2.0:1776191505.658860:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630929152
00000100:00100000:2.0:1776191505.658878:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2371
00000100:00100000:2.0:1776191505.658882:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a0c5ca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630929088:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191505.658918:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ad77ca4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630928768:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191505.658947:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191505.658964:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ce2fb2ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630929024:0@lo:400:kworker/u8:2.0
00010000:02020000:2.0:1776191505.658979:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191505.658988:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191505.659010:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:0.0:1776191505.659017:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000150035b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630928704:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191505.659025:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a0c5ca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630929088:12345-0@lo:8:kworker/u8:2.0 Request processed in 140us (300us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191505.659054:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2371
00000100:00100000:2.0:1776191505.659068:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630929024
00000100:00100000:2.0:1776191505.659091:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2066
00000100:00100000:2.0:1776191505.659095:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009af94ad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630929024:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191505.659222:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011eb3cbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630929344:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191505.659280:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009af94ad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630929024:12345-0@lo:400:kworker/u8:2.0 Request processed in 183us (292us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191505.659288:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2066
00000100:00100000:1.0:1776191505.659292:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006de4f7b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630928896:12345-0@lo:400:kworker/u8:2.0 Request processed in 484us (756us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191505.659301:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4776
00000100:00100000:2.0:1776191505.659308:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2372
00000100:00100000:2.0:1776191505.659313:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000086a13048 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630929152:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191505.659319:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630928768
00000100:00100000:1.0:1776191505.659345:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4777
00000100:00100000:1.0:1776191505.659348:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bd8aa733 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630929280:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191505.659373:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bd8aa733 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630929280:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (780us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191505.659378:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4777
00000100:00100000:1.0:1776191505.659388:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4778
00000100:00100000:1.0:1776191505.659392:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000012367763 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630929216:12345-0@lo:400:kworker/u8:2.0
00010000:02020000:2.0:1776191505.659402:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191505.659419:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000012367763 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630929216:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (716us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191505.659426:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4778
00000100:00100000:2.0:1776191505.659440:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000086a13048 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630929152:12345-0@lo:8:kworker/u8:2.0 Request processed in 125us (663us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191505.659443:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4779
00000100:00100000:1.0:1776191505.659451:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000155ae841 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630928768:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191505.659453:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2372
00000100:00100000:1.0:1776191505.659490:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000155ae841 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630928768:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (542us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191505.659490:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630928832
00000100:00100000:1.0:1776191505.659498:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4779
00000100:00100000:2.0:1776191505.659519:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3251
00000100:00100000:2.0:1776191505.659524:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002460ac97 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630928832:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191505.659541:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a6460e87 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630929216:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191505.659556:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003117df42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630928896:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191505.659564:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002460ac97 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630928832:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (892us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191505.659570:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000cbdfd62 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630929280:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191505.659613:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e3e12bd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630928832:0@lo:400:kworker/u8:2.0
00000100:00080000:1.0:1776191505.659692:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191505.659696:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191505.659699:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000074fc7059 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630929088:0@lo:8:kworker/u8:2.0
00000100:00080000:1.0:1776191505.659705:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191505.659708:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191505.659709:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004bce44f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630929152:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191505.659951:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3251
00000100:00100000:3.0:1776191505.661516:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191505.661716:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630929344
00000100:00100000:2.0:1776191505.661760:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1640
00000100:00100000:2.0:1776191505.661765:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb1d57ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630929344:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191505.661793:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191505.661976:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191505.662010:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000034f2f5bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630928960:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191505.662074:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191505.662095:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630928704
00000100:00100000:0.0:1776191505.662111:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ad77ca4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630928768:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191505.662126:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ce2fb2ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630929024:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191505.662131:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1790
00000100:00100000:1.0:1776191505.662136:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cef7ed6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630928704:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191505.662174:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630928960
00000100:00100000:1.0:1776191505.662183:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cef7ed6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630928704:12345-0@lo:400:kworker/u8:2.0 Request processed in 45us (208us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191505.662191:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1790
00000100:00100000:0.0:1776191505.662206:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3252
00000100:00100000:0.0:1776191505.662211:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3653833 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630928960:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191505.662236:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000150035b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630928704:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191505.662260:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3653833 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630928960:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (186us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191505.662266:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3252
00000100:00100000:1.0:1776191505.663755:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000034f2f5bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630928960:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191505.663917:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb1d57ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630929344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2150us (2405us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191505.663926:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1640
00000100:00100000:3.0:1776191505.664141:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011eb3cbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630929344:0@lo:13:osp-pre-0-0.0
00010000:00010000:3.0:1776191506.426402:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191507.294975:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191507.295084:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191507.295112:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191507.295140:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191507.295375:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613804544
00000100:00100000:2.0:1776191507.295429:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613804608
00000100:00100000:2.0:1776191507.295458:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4780
00000100:00100000:2.0:1776191507.295464:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006556f9ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613804544:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191507.295554:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006556f9ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613804544:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 89us (521us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191507.295562:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4780
00000100:00100000:2.0:1776191507.295579:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4781
00000100:00100000:2.0:1776191507.295584:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008735dcd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613804608:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191507.295608:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008735dcd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613804608:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 24us (496us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191507.295615:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4781
00000100:00100000:2.0:1776191507.295635:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613804672
00000100:00100000:2.0:1776191507.295657:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2067
00000100:00100000:2.0:1776191507.295661:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c2466414 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613804672:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191507.295685:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c2466414 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613804672:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 23us (546us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191507.295690:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2067
00000100:00100000:0.0:1776191507.296010:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613804480
00000100:00100000:0.0:1776191507.296075:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1791
00000100:00100000:0.0:1776191507.296079:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000000cecea7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613804480:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191507.296103:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000000cecea7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613804480:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 24us (1138us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191507.296108:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1791
00000100:00100000:3.0:1776191507.296893:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191507.297696:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613804736
00000100:00100000:1.0:1776191507.297748:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2373
00000100:00100000:1.0:1776191507.297753:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000011eb3cbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613804736:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:1.0:1776191507.297864:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191507.297926:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000011eb3cbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613804736:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 172us (1038us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191507.297934:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2373
00010000:00010000:0.0:1776191507.450635:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191508.475487:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191508.731577:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d60a5454 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630929408:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191508.731642:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191508.731768:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630929408
00000100:00100000:0.0:1776191508.731814:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3253
00000100:00100000:0.0:1776191508.731820:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003d78e42e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630929408:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191508.731855:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191508.731901:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003d78e42e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630929408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (259us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191508.731907:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3253
00000100:00100000:1.0:1776191508.732022:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d60a5454 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630929408:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191509.502771:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191509.754806:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000061ace3cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630929472:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191509.754875:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191509.755383:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630929472
00000100:00100000:0.0:1776191509.755435:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3254
00000100:00100000:0.0:1776191509.755442:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000481c290f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630929472:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191509.755474:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191509.756143:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000481c290f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630929472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 699us (1267us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191509.756152:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3254
00000100:00100000:3.0:1776191509.756288:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000061ace3cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630929472:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191510.522354:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1776191510.778318:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191510.778326:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191510.778330:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191510.778338:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4043
00000100:00080000:2.0:1776191510.778342:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191510.778348:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191510.778371:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000e72cee95 x1862467630930048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191510.778388:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191510.778391:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191510.778392:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191510.778397:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4043
00000100:00100000:3.0:1776191510.778397:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fb519ed0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630929600:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1776191510.778401:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191510.778406:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191510.778419:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000cf2c1df6 x1862467630930112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191510.778478:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191510.778512:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009d908df0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630929856:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191510.778537:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191510.778562:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:3.0:1776191510.778567:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630929664:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191510.778597:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191510.778614:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f5f736f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630929920:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191510.778634:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191510.778664:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008a102519 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630929728:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191510.778690:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191510.778706:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630929600
00000100:00100000:3.0:1776191510.778709:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e56d17f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630929984:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191510.778733:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191510.778751:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1641
00000100:00100000:3.0:1776191510.778753:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [3->2]
00000100:00100000:2.0:1776191510.778758:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000994ca5e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630929600:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191510.778762:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d60a5454 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630929536:0@lo:400:kworker/u8:4.0
00002000:00000024:2.0:1776191510.778793:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191510.778806:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191510.778828:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000365abfb8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630929792:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191510.778840:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000994ca5e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630929600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (361us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191510.778850:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1641
00000100:00100000:3.0:1776191510.778854:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191510.778873:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007756d7ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630930176:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191510.778897:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630929920
00000100:00100000:3.0:1776191510.778897:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191510.778928:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630929984
00000100:00100000:3.0:1776191510.778936:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630929856
00000100:00100000:2.0:1776191510.778950:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2068
00000100:00100000:2.0:1776191510.778955:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029599f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630929920:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191510.778987:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029599f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630929920:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (352us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191510.778993:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2068
00000100:00100000:2.0:1776191510.779004:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2069
00000100:00100000:2.0:1776191510.779008:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001105f678 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630929984:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191510.779297:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630929728
00000100:00100000:3.0:1776191510.779316:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3255
00000100:00100000:3.0:1776191510.779320:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003f01d2f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630929856:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191510.779429:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3256
00000100:00100000:0.0:1776191510.779435:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f2477cb3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630929728:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191510.779916:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004250bccf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630930304:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191510.779992:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001105f678 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630929984:12345-0@lo:400:kworker/u8:4.0 Request processed in 983us (1258us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191510.779999:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2069
00000100:00100000:2.0:1776191510.780069:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630929664
00000100:00100000:2.0:1776191510.780093:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630929792
00000100:00100000:2.0:1776191510.780106:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630930176
00000100:00100000:2.0:1776191510.780123:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4782
00000100:00100000:2.0:1776191510.780127:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a9e71f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630929664:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191510.784906:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003f01d2f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630929856:12345-0@lo:400:kworker/u8:4.0 Request processed in 5332us (6116us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191510.785335:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3255
00000100:00100000:3.0:1776191510.785391:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4783
00000100:00100000:3.0:1776191510.785397:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004cf2553a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630929792:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191510.785817:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f2477cb3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630929728:12345-0@lo:400:kworker/u8:4.0 Request processed in 6381us (7127us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191510.785826:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3256
00000100:00100000:0.0:1776191510.785852:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4784
00000100:00100000:0.0:1776191510.785857:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009e49d076 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630930176:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191510.785893:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009e49d076 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630930176:12345-0@lo:400:kworker/u8:4.0 Request processed in 36us (6997us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191510.785898:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4784
00000100:00100000:2.0:1776191510.786783:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a9e71f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630929664:12345-0@lo:400:kworker/u8:4.0 Request processed in 6652us (8183us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191510.786793:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4782
00000100:00100000:2.0:1776191510.786838:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630929536
00000100:00100000:2.0:1776191510.786877:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1792
00000100:00100000:2.0:1776191510.786882:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e23389f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630929536:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191510.786919:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e23389f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630929536:12345-0@lo:400:kworker/u8:4.0 Request processed in 38us (8115us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191510.786925:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1792
00000100:00100000:2.0:1776191510.786964:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000041c7ca25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630930240:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191510.786993:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191510.787031:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630929664:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191510.787060:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f5f736f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630929920:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191510.787076:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fb519ed0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630929600:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191510.787087:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009d908df0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630929856:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191510.787125:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630930240
00000100:00100000:2.0:1776191510.787150:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4785
00000100:00100000:2.0:1776191510.787160:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a8f703ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630930240:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191510.787194:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a8f703ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630930240:12345-0@lo:400:kworker/u8:4.0 Request processed in 38us (200us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191510.787200:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4785
00000100:00100000:2.0:1776191510.787225:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000041c7ca25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630930240:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191510.787247:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191510.787308:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630930304
00000100:00100000:1.0:1776191510.787336:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1642
00000100:00100000:1.0:1776191510.787340:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0aeb4f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630930304:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191510.787356:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191510.787379:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d60a5454 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630929536:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191510.787412:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0aeb4f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630930304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (641us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191510.787421:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1642
00000100:00100000:2.0:1776191510.787443:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000365abfb8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630929792:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191510.787446:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004cf2553a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630929792:12345-0@lo:400:kworker/u8:4.0 Request processed in 2046us (8590us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191510.787477:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004250bccf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630930304:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191510.787478:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007756d7ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630930176:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191510.787624:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008a102519 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630929728:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191510.787638:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e56d17f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630929984:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191510.788597:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4783
00000100:00100000:0.0:1776191510.788632:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e72cee95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630930048:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191510.788689:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191510.788820:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cf2c1df6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630930112:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191510.788844:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191510.789476:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630930048
00000100:00100000:2.0:1776191510.789542:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630930112
00000100:00100000:2.0:1776191510.789575:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2374
00000100:00100000:2.0:1776191510.789581:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004250bccf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630930048:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191510.789685:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191510.789746:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004250bccf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630930048:12345-0@lo:8:kworker/u8:4.0 Request processed in 165us (1057us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191510.789754:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2374
00000100:00100000:2.0:1776191510.789766:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2375
00000100:00100000:2.0:1776191510.789770:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb519ed0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630930112:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191510.789912:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191510.789937:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb519ed0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630930112:12345-0@lo:8:kworker/u8:4.0 Request processed in 167us (1094us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191510.789943:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2375
00000100:00080000:3.0:1776191510.790553:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191510.790559:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191510.790564:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e72cee95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630930048:0@lo:8:kworker/u8:4.0
00000100:00080000:3.0:1776191510.790573:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191510.790576:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191510.790578:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cf2c1df6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630930112:0@lo:8:kworker/u8:4.0
00010000:00010000:3.0:1776191511.547332:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191512.415107:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191512.415160:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191512.415206:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191512.415243:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191512.415499:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613804928
00000100:00100000:0.0:1776191512.415555:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4786
00000100:00100000:0.0:1776191512.415562:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad751c29 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613804928:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191512.415635:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad751c29 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613804928:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 73us (475us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191512.415643:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4786
00000100:00100000:0.0:1776191512.415661:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613804864
00000100:00100000:0.0:1776191512.415678:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4787
00000100:00100000:0.0:1776191512.415682:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f62c71af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613804864:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191512.415705:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f62c71af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613804864:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 22us (499us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191512.415711:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4787
00000100:00100000:2.0:1776191512.415934:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613804992
00000100:00100000:2.0:1776191512.415970:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2070
00000100:00100000:2.0:1776191512.415974:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a0236b56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613804992:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191512.416002:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a0236b56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613804992:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 27us (759us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191512.416009:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2070
00000100:00100000:0.0:1776191512.416558:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191512.416681:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613804800
00000100:00100000:0.0:1776191512.416717:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1793
00000100:00100000:0.0:1776191512.416722:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4da44d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613804800:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191512.416755:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4da44d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613804800:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 32us (1654us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191512.416760:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1793
00000100:00100000:1.0:1776191512.417712:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613805056
00000100:00100000:1.0:1776191512.417755:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2376
00000100:00100000:1.0:1776191512.417760:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a2b80b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613805056:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:1.0:1776191512.417853:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191512.417901:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a2b80b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613805056:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 141us (1345us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191512.418062:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2376
00010000:00010000:3.0:1776191512.570364:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191513.594757:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191513.850549:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007756d7ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630930368:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191513.850626:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191513.850724:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630930368
00000100:00100000:1.0:1776191513.850783:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3257
00000100:00100000:1.0:1776191513.850789:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af44226e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630930368:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191513.850821:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191513.850872:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af44226e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630930368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (247us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191513.850879:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3257
00000100:00100000:2.0:1776191513.851438:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007756d7ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630930368:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191514.620056:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191514.874275:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1776191514.874289:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011caeb27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630930432:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191514.874351:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191514.874450:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630930432
00000100:00100000:1.0:1776191514.874499:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3258
00000100:00100000:1.0:1776191514.874505:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2e3dc1e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630930432:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191514.874537:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191514.874581:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2e3dc1e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630930432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (231us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191514.874587:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3258
00000100:00100000:3.0:1776191514.874708:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011caeb27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630930432:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191515.643640:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191515.898323:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055f4b7ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630930496:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191515.898404:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191515.899417:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630930496
00000100:00100000:0.0:1776191515.899471:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1643
00000100:00100000:0.0:1776191515.899476:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007756d7ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630930496:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191515.899507:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191515.899569:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007756d7ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630930496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (1166us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191515.899576:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1643
00000100:00100000:3.0:1776191515.900019:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055f4b7ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630930496:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191515.900335:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a0f2d502 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630930560:0@lo:400:kworker/u8:2.0
00000100:00080000:1.0:1776191515.900404:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1776191515.900408:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011caeb27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630930624:0@lo:400:kworker/u8:2.0
00000100:00080000:1.0:1776191515.900411:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191515.900421:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191515.900427:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4048
00000100:00080000:1.0:1776191515.900430:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191515.900434:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191515.900452:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191515.900456:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000003117df42 x1862467630931008/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191515.900475:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1776191515.900478:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ad77ca4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630930880:0@lo:400:kworker/u8:2.0
00000100:00080000:1.0:1776191515.900480:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191515.900482:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191515.900487:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4048
00000100:00080000:1.0:1776191515.900491:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00100000:3.0:1776191515.900492:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191515.900497:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191515.900510:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191515.900514:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000034f2f5bc x1862467630931072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191515.900522:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000150035b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630930816:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191515.900537:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:0.0:1776191515.900546:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d0e4254d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630930688:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191515.900553:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191515.900600:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000061ace3cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630930752:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191515.900728:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630930624
00000100:00100000:1.0:1776191515.900759:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630930816
00000100:00100000:1.0:1776191515.900779:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4788
00000100:00100000:1.0:1776191515.900783:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000055f4b7ff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630930624:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191515.903343:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004bce44f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630931200:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191515.903422:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191515.903473:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003117df42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630931008:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191515.903500:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191515.903516:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000034f2f5bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630931072:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191515.903539:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191515.903577:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630930560
00000100:00100000:3.0:1776191515.903621:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1794
00000100:00100000:3.0:1776191515.903627:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e54e7edc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630930560:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191515.903676:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e54e7edc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630930560:12345-0@lo:400:kworker/u8:2.0 Request processed in 49us (3188us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191515.903684:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1794
00000100:00100000:3.0:1776191515.903720:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630931200
00000100:00100000:3.0:1776191515.903756:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4789
00000100:00100000:3.0:1776191515.903761:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002cd3d4b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630930816:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191515.903794:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002cd3d4b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630930816:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (3242us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191515.903800:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4789
00000100:00100000:3.0:1776191515.903814:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4790
00000100:00100000:3.0:1776191515.903817:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000160230d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630931200:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191515.903842:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000160230d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630931200:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (421us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191515.903847:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4790
00000100:00100000:3.0:1776191515.903870:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630931008
00000100:00100000:3.0:1776191515.903888:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630931072
00000100:00100000:3.0:1776191515.903910:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2377
00000100:00100000:3.0:1776191515.903914:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049908ee0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630931008:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191515.904372:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191515.904415:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049908ee0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630931008:12345-0@lo:8:kworker/u8:2.0 Request processed in 499us (914us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191515.904423:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2377
00000100:00100000:3.0:1776191515.904436:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2378
00000100:00100000:3.0:1776191515.904440:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004da0b0e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630931072:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191515.904522:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191515.904544:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004da0b0e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630931072:12345-0@lo:8:kworker/u8:2.0 Request processed in 103us (1005us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191515.904550:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2378
00000100:00100000:3.0:1776191515.904580:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630930880
00000100:00100000:3.0:1776191515.904605:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3259
00000100:00100000:3.0:1776191515.904609:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030c9704c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630930880:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191515.904639:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030c9704c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630930880:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (4131us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191515.904645:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3259
00000100:00080000:3.0:1776191515.904678:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191515.904682:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191515.904685:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003117df42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630931008:0@lo:8:kworker/u8:2.0
00000100:00080000:3.0:1776191515.904693:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191515.904695:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191515.904698:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000034f2f5bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630931072:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191515.904732:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004bce44f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630931200:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191515.904742:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000150035b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630930816:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191515.904751:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a0f2d502 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630930560:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191515.905104:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191515.905125:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ce2fb2ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630931136:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191515.905154:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191515.905187:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630931136
00000100:00100000:2.0:1776191515.905212:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4791
00000100:00100000:2.0:1776191515.905216:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006644a6e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630931136:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191515.905252:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006644a6e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630931136:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (97us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191515.905258:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4791
00000100:00100000:2.0:1776191515.905284:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ce2fb2ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630931136:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191515.905473:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000055f4b7ff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630930624:12345-0@lo:400:kworker/u8:2.0 Request processed in 4687us (5021us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191515.905479:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4788
00000100:00100000:0.0:1776191515.905528:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191515.905593:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e3e12bd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630930944:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191515.905618:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191515.905647:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011caeb27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630930624:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191515.905657:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ad77ca4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630930880:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191515.905720:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630930944
00000100:00100000:1.0:1776191515.905759:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2071
00000100:00100000:1.0:1776191515.905763:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ea373370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630930944:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191515.905795:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ea373370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630930944:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (176us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191515.905802:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2071
00000100:00100000:0.0:1776191515.905865:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e3e12bd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630930944:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191515.905912:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630930688
00000100:00100000:2.0:1776191515.905977:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1644
00000100:00100000:2.0:1776191515.905993:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9a725e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630930688:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191515.906009:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191515.906077:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9a725e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630930688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (549us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191515.906092:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1644
00000100:00100000:1.0:1776191515.906146:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0e4254d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630930688:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191515.906180:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630930752
00000100:00100000:3.0:1776191515.906215:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3260
00000100:00100000:3.0:1776191515.906219:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000041c7ca25 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630930752:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191515.906259:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000041c7ca25 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630930752:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (1155us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191515.906264:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3260
00000100:00100000:3.0:1776191515.906301:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000061ace3cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630930752:0@lo:400:kworker/u8:2.0
00010000:00010000:0.0:1776191516.668289:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191517.532702:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191517.532767:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191517.532803:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191517.532842:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191517.532926:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613805184
00000100:00100000:2.0:1776191517.532980:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613805248
00000100:00100000:2.0:1776191517.533005:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4792
00000100:00100000:2.0:1776191517.533020:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000074fc7059 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613805184:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191517.533125:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000074fc7059 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613805184:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 113us (357us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191517.533136:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4792
00000100:00100000:2.0:1776191517.533154:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4793
00000100:00100000:2.0:1776191517.533158:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a6460e87 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613805248:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191517.533181:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a6460e87 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613805248:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 22us (339us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191517.533187:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4793
00000100:00100000:1.0:1776191517.533273:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613805312
00000100:00100000:1.0:1776191517.533298:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2072
00000100:00100000:1.0:1776191517.533302:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000cbdfd62 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613805312:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191517.533352:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000cbdfd62 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613805312:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 48us (549us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191517.533359:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2072
00000100:00100000:3.0:1776191517.533687:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613805120
00000100:00100000:3.0:1776191517.533723:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1795
00000100:00100000:3.0:1776191517.533727:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f9ea876 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613805120:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191517.533770:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f9ea876 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613805120:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 41us (1076us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191517.533777:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1795
00000100:00100000:0.0:1776191517.539504:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191517.539630:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613805376
00000100:00100000:1.0:1776191517.539682:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2379
00000100:00100000:1.0:1776191517.539689:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008dbfa9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613805376:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:1.0:1776191517.539792:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191517.539943:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008dbfa9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613805376:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 253us (444us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191517.539950:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2379
00010000:00010000:3.0:1776191517.692773:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191518.716397:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191518.972072:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1776191518.974595:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000016dc0009 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630931264:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191518.975164:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191518.975265:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630931264
00000100:00100000:0.0:1776191518.975331:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3261
00000100:00100000:0.0:1776191518.975337:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb97b35c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630931264:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191518.975372:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191518.975589:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb97b35c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630931264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 252us (426us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191518.975601:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3261
00000100:00100000:2.0:1776191518.976322:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000016dc0009 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630931264:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191519.738624:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191519.994826:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ce2fb2ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630931328:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191519.994893:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191519.995145:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630931328
00000100:00100000:1.0:1776191519.995204:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3262
00000100:00100000:1.0:1776191519.995210:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016dc0009 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630931328:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191519.995620:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191519.995733:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016dc0009 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630931328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 522us (841us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191519.995741:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3262
00000100:00100000:2.0:1776191519.998339:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ce2fb2ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630931328:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191520.766478:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1776191521.018324:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191521.018332:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191521.018335:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191521.018343:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4053
00000100:00080000:2.0:1776191521.018348:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191521.018354:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191521.018374:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000009ec90674 x1862467630931840/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191521.018385:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000640b7818 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630931520:0@lo:400:kworker/u8:2.0
00000100:00080000:2.0:1776191521.018386:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191521.018389:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191521.018390:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191521.018392:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4053
00000100:00080000:2.0:1776191521.018394:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191521.018398:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191521.018407:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000af393e55 x1862467630931904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191521.018437:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e555734e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630931584:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191521.018453:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191521.018477:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006776e411 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630931776:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191521.018477:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191521.018497:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e486c123 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630931968:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191521.018498:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191521.018515:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191521.018535:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630931776
00000100:00100000:2.0:1776191521.018539:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630931584
00000100:00100000:2.0:1776191521.018571:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630931968
00000100:00100000:0.0:1776191521.018573:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2073
00000100:00100000:0.0:1776191521.018579:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029b0687d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630931776:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191521.018586:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4794
00000100:00100000:2.0:1776191521.018589:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ede69d54 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630931584:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191521.018630:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029b0687d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630931776:12345-0@lo:400:kworker/u8:2.0 Request processed in 51us (131us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191521.018637:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2073
00000100:00100000:0.0:1776191521.018697:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006776e411 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630931776:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191521.018729:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ede69d54 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630931584:12345-0@lo:400:kworker/u8:2.0 Request processed in 138us (263us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191521.018735:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4794
00000100:00100000:0.0:1776191521.018746:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4795
00000100:00100000:0.0:1776191521.018750:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cf2c1df6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630931968:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191521.018786:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000263400d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630931392:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191521.018809:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630931520
00000100:00100000:1.0:1776191521.018819:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191521.018833:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f74cc947 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630931648:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191521.018833:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3263
00000100:00100000:3.0:1776191521.018836:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009916a1d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630931520:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191521.018854:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191521.018863:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dfe84e20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630932032:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191521.018864:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009916a1d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630931520:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (414us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191521.018872:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3263
00000100:00100000:1.0:1776191521.018879:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191521.018883:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630931648
00000100:00100000:3.0:1776191521.018894:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3264
00000100:00100000:1.0:1776191521.018895:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [1->0]
00000100:00100000:3.0:1776191521.018897:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004bce44f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630931648:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191521.018899:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000950cd033 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630931456:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191521.018917:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191521.018919:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004bce44f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630931648:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (65us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191521.018924:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3264
00000100:00100000:1.0:1776191521.018929:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e2ce3f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630931712:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191521.018942:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ec90674 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630931840:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191521.018950:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191521.018962:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d0c84519 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630932096:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191521.018962:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191521.018973:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000af393e55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630931904:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191521.018982:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191521.018987:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191521.019000:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f74cc947 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630931648:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191521.019010:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630931712
00000100:00100000:1.0:1776191521.019020:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630932032
00000100:00100000:3.0:1776191521.019028:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630931840
00000100:00100000:0.0:1776191521.019289:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cf2c1df6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630931968:12345-0@lo:400:kworker/u8:2.0 Request processed in 538us (774us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191521.019344:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630931456
00000100:00100000:2.0:1776191521.019366:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4796
00000100:00100000:2.0:1776191521.019370:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ce2fb2ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630931456:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191521.019403:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ce2fb2ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630931456:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (486us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191521.019408:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4796
00000100:00100000:2.0:1776191521.019430:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630931392
00000100:00100000:2.0:1776191521.019450:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1796
00000100:00100000:2.0:1776191521.019453:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000653a1d11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630931392:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191521.019480:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000653a1d11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630931392:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (661us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191521.019487:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1796
00000100:00100000:3.0:1776191521.019498:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630931904
00000100:00100000:3.0:1776191521.019515:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2074
00000100:00100000:3.0:1776191521.019518:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d0e4254d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630931712:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191521.019519:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000950cd033 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630931456:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191521.019527:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000263400d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630931392:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191521.019561:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d0e4254d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630931712:12345-0@lo:400:kworker/u8:2.0 Request processed in 42us (610us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191521.019566:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2074
00000100:00100000:3.0:1776191521.019578:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2380
00000100:00100000:3.0:1776191521.019581:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa41a1c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630931840:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191521.019682:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191521.019724:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa41a1c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630931840:12345-0@lo:8:kworker/u8:2.0 Request processed in 142us (762us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191521.019730:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2380
00000100:00100000:3.0:1776191521.019743:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2381
00000100:00100000:3.0:1776191521.019746:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000057cf3599 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630931904:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191521.019822:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191521.019845:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000057cf3599 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630931904:12345-0@lo:8:kworker/u8:2.0 Request processed in 98us (858us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191521.019850:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2381
00000100:00080000:3.0:1776191521.019886:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191521.019890:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191521.019893:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ec90674 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630931840:0@lo:8:kworker/u8:2.0
00000100:00080000:3.0:1776191521.019900:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191521.019902:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191521.019904:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000af393e55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630931904:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191521.019932:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e2ce3f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630931712:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191521.019965:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e555734e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630931584:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191521.019974:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e486c123 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630931968:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191521.020026:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004a57869 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630932160:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191521.020067:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191521.020090:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000640b7818 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630931520:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191521.020130:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630932096
00000100:00100000:3.0:1776191521.020151:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630932160
00000100:00100000:3.0:1776191521.020162:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1645
00000100:00100000:3.0:1776191521.020166:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027e578e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630932096:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191521.020184:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191521.020212:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027e578e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630932096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (1229us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191521.020217:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1645
00000100:00100000:3.0:1776191521.020240:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1646
00000100:00100000:3.0:1776191521.020252:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000038340710 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630932160:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191521.020260:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191521.020283:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000038340710 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630932160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 30us (216us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191521.020288:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1646
00000100:00100000:3.0:1776191521.020312:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004a57869 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630932160:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191521.020348:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0c84519 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630932096:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191521.028084:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4797
00000100:00100000:1.0:1776191521.028095:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000034f2f5bc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630932032:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191521.028214:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000034f2f5bc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630932032:12345-0@lo:400:kworker/u8:2.0 Request processed in 120us (9333us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191521.028222:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4797
00000100:00100000:2.0:1776191521.028420:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dfe84e20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630932032:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191521.030527:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4795
00010000:00010000:3.0:1776191521.789817:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191522.661475:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191522.661515:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191522.661543:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191522.661579:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191522.661617:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191522.661651:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613805632
00000100:00100000:1.0:1776191522.661694:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613805696
00000100:00100000:1.0:1776191522.661713:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2075
00000100:00100000:1.0:1776191522.661719:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007cae42a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613805632:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191522.661784:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007cae42a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613805632:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 65us (205us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191522.661792:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2075
00000100:00100000:1.0:1776191522.661808:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2382
00000100:00100000:1.0:1776191522.661811:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009065a894 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613805696:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:1.0:1776191522.661904:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191522.661931:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009065a894 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613805696:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 117us (324us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191522.661937:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2382
00000100:00100000:3.0:1776191522.662438:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613805440
00000100:00100000:3.0:1776191522.662473:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1797
00000100:00100000:0.0:1776191522.662477:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613805568
00000100:00100000:3.0:1776191522.662479:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd6c2b01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613805440:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191522.662510:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613805504
00000100:00100000:3.0:1776191522.662521:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd6c2b01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613805440:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 41us (1054us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191522.662529:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1797
00000100:00100000:0.0:1776191522.662537:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4798
00000100:00100000:0.0:1776191522.662543:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000906a5df3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613805568:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191522.662565:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4799
00000100:00100000:3.0:1776191522.662571:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000276fe5cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613805504:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191522.662579:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000906a5df3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613805568:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 34us (1063us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191522.662586:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4798
00000100:00100000:3.0:1776191522.662604:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000276fe5cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613805504:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 32us (1059us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191522.662624:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4799
00010000:00010000:3.0:1776191522.810351:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191523.834357:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191524.090656:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dfe84e20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630932224:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191524.090722:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191524.090826:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630932224
00000100:00100000:2.0:1776191524.090873:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3265
00000100:00100000:2.0:1776191524.090878:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004a57869 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630932224:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191524.090910:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191524.090956:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004a57869 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630932224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (233us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191524.090964:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3265
00000100:00100000:2.0:1776191524.091009:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dfe84e20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630932224:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191524.858818:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191525.115766:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008ba53a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630932288:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191525.115844:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191525.115937:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630932288
00000100:00100000:1.0:1776191525.115988:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3266
00000100:00100000:1.0:1776191525.115996:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dfe84e20 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630932288:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191525.116030:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191525.116098:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dfe84e20 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630932288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (254us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191525.116105:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3266
00000100:00100000:2.0:1776191525.116202:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008ba53a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630932288:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191525.882403:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191526.139162:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d0c84519 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630932416:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191526.139231:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191526.139374:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000250a4bd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630932352:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191526.139403:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191526.139933:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630932416
00000100:00100000:0.0:1776191526.139980:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630932352
00000100:00100000:0.0:1776191526.140003:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1647
00000100:00100000:0.0:1776191526.140008:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c904ec5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630932416:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191526.140058:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191526.140105:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c904ec5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630932416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (875us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191526.140115:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1647
00000100:00100000:0.0:1776191526.140140:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1648
00000100:00100000:0.0:1776191526.140145:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae6c8b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630932352:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191526.140153:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191526.140175:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae6c8b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630932352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 30us (772us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191526.140180:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1648
00000100:00100000:0.0:1776191526.140221:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0c84519 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630932416:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191526.140528:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000250a4bd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630932352:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191526.141261:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000263400d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630932480:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191526.141312:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191526.141915:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e72cee95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630932608:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191526.141950:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191526.141972:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191526.141978:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000950cd033 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630932544:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191526.142003:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191526.142050:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630932608
00000100:00100000:0.0:1776191526.142087:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3267
00000100:00100000:0.0:1776191526.142091:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d0c84519 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630932608:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191526.142145:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d0c84519 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630932608:12345-0@lo:400:kworker/u8:2.0 Request processed in 52us (195us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191526.142152:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3267
00000100:00100000:0.0:1776191526.142175:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630932544
00000100:00100000:0.0:1776191526.142196:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4800
00000100:00100000:0.0:1776191526.142200:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e802cd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630932544:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191526.142228:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e802cd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630932544:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (224us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191526.142237:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4800
00000100:00100000:0.0:1776191526.142267:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000950cd033 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630932544:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191526.142276:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e72cee95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630932608:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191526.142311:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000640b7818 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630932672:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191526.142345:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191526.142372:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630932672
00000100:00100000:0.0:1776191526.142394:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4801
00000100:00100000:0.0:1776191526.142398:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000079f65e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630932672:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191526.142773:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630932480
00000100:00100000:1.0:1776191526.142802:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1798
00000100:00100000:1.0:1776191526.142806:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000040bbf344 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630932480:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191526.143348:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e486c123 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630932736:0@lo:400:kworker/u8:2.0
00000100:00080000:2.0:1776191526.143446:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191526.143450:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191526.143453:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191526.143458:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4059
00000100:00080000:2.0:1776191526.143460:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191526.143463:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191526.143492:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000e555734e x1862467630932800/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191526.143507:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191526.143510:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191526.143511:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191526.143514:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4059
00000100:00080000:2.0:1776191526.143524:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191526.143527:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191526.143536:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000005e2ce3f1 x1862467630932864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191526.143574:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e555734e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630932800:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191526.143653:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000040bbf344 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630932480:12345-0@lo:400:kworker/u8:2.0 Request processed in 845us (2342us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191526.143660:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1798
00000100:00100000:1.0:1776191526.143709:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000af393e55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630932928:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191526.143732:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191526.143749:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191526.143754:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ec90674 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630932992:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191526.143772:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191526.143793:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630932928
00000100:00100000:1.0:1776191526.143818:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630932992
00000100:00100000:1.0:1776191526.143833:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4802
00000100:00100000:1.0:1776191526.143836:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c05da7e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630932928:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191526.143869:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c05da7e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630932928:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (137us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191526.143875:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4802
00000100:00100000:1.0:1776191526.143884:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4803
00000100:00100000:1.0:1776191526.143888:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000008ba53a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630932992:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191526.143908:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000008ba53a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630932992:12345-0@lo:400:kworker/u8:2.0 Request processed in 20us (136us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191526.143913:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4803
00000100:00100000:1.0:1776191526.143944:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ec90674 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630932992:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191526.143952:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000af393e55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630932928:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191526.144353:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000079f65e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630932672:12345-0@lo:400:kworker/u8:2.0 Request processed in 1953us (2007us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191526.144360:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4801
00000100:00100000:1.0:1776191526.144530:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000640b7818 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630932672:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191526.144758:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191526.144782:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000263400d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630932480:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191526.144853:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630932736
00000100:00100000:0.0:1776191526.144888:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3268
00000100:00100000:0.0:1776191526.144892:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000690142e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630932736:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191526.144943:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000690142e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630932736:12345-0@lo:400:kworker/u8:2.0 Request processed in 50us (185us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191526.144949:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3268
00000100:00100000:1.0:1776191526.145011:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e486c123 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630932736:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191526.145113:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191526.145176:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e2ce3f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630932864:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191526.145203:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191526.145440:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630932800
00000100:00100000:3.0:1776191526.145472:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630932864
00000100:00100000:3.0:1776191526.146586:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2383
00000100:00100000:3.0:1776191526.146595:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f74cc947 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630932800:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191526.146700:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191526.146772:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f74cc947 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630932800:12345-0@lo:8:kworker/u8:2.0 Request processed in 176us (1660us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191526.146779:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2383
00000100:00100000:3.0:1776191526.146795:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2384
00000100:00100000:3.0:1776191526.146798:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006776e411 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630932864:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191526.147166:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191526.147194:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006776e411 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630932864:12345-0@lo:8:kworker/u8:2.0 Request processed in 394us (1991us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191526.147201:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2384
00000100:00080000:2.0:1776191526.151080:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191526.151090:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191526.151098:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e555734e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630932800:0@lo:8:kworker/u8:2.0
00000100:00080000:2.0:1776191526.151111:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191526.151114:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191526.151116:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e2ce3f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630932864:0@lo:8:kworker/u8:2.0
00010000:00010000:3.0:1776191526.906334:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191527.772532:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191527.772589:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191527.772613:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613805760
00000100:00100000:1.0:1776191527.772624:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191527.772669:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191527.772669:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1799
00000100:00100000:2.0:1776191527.772680:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bbf84eea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613805760:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191527.772703:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613805952
00000100:00100000:1.0:1776191527.772735:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2076
00000100:00100000:1.0:1776191527.772740:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b5928219 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613805952:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191527.772749:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bbf84eea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613805760:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 69us (223us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191527.772761:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1799
00000100:00100000:1.0:1776191527.772775:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b5928219 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613805952:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 33us (111us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191527.772784:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2076
00000100:00100000:3.0:1776191527.772934:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613805824
00000100:00100000:3.0:1776191527.772984:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613805888
00000100:00100000:0.0:1776191527.772998:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191527.773023:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613806016
00000100:00100000:0.0:1776191527.773086:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2385
00000100:00100000:0.0:1776191527.773091:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000eb05ee3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613806016:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:0.0:1776191527.773194:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191527.773229:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000eb05ee3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613806016:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 138us (234us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191527.773236:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2385
00000100:00100000:0.0:1776191527.773292:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4804
00000100:00100000:0.0:1776191527.773296:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c7c28c8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613805824:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191527.773328:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c7c28c8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613805824:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 31us (741us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191527.773334:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4804
00000100:00100000:0.0:1776191527.773347:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4805
00000100:00100000:0.0:1776191527.773351:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ca51694 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613805888:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191527.773374:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ca51694 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613805888:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 22us (752us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191527.773380:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4805
00010000:00010000:3.0:1776191527.930314:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191528.954649:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191529.210820:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e2ce3f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630933056:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191529.210904:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191529.212173:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630933056
00000100:00100000:3.0:1776191529.212233:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3269
00000100:00100000:3.0:1776191529.212240:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b6af7b47 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630933056:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191529.212272:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191529.212331:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b6af7b47 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630933056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (1428us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191529.212338:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3269
00000100:00100000:0.0:1776191529.212742:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e2ce3f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630933056:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191529.978370:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191530.234311:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000054825189 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630933120:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191530.234383:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191530.234731:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630933120
00000100:00100000:1.0:1776191530.234830:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3270
00000100:00100000:1.0:1776191530.234837:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005fa5d8be pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630933120:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191530.234874:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191530.234926:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005fa5d8be pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630933120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (544us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191530.234933:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3270
00000100:00100000:3.0:1776191530.235122:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000054825189 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630933120:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191531.002384:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191531.258319:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7c3b55d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630933184:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1776191531.258347:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191531.258353:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191531.258356:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191531.258361:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4064
00000100:00080000:3.0:1776191531.258364:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191531.258370:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191531.258388:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191531.258392:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000e3e12bd4 x1862467630933696/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191531.258412:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191531.258416:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191531.258417:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191531.258420:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4064
00000100:00080000:3.0:1776191531.258423:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00100000:1.0:1776191531.258425:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000061ace3cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630933504:0@lo:400:kworker/u8:4.0
00000100:00080000:3.0:1776191531.258428:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191531.258441:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000000ad77ca4 x1862467630933760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191531.258471:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191531.258525:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048d62137 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630933312:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191531.258557:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191531.258578:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011caeb27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630933568:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191531.258602:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191531.258617:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6387b57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630933952:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191531.258636:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191531.258654:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:0.0:1776191531.258659:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c4e82865 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630933376:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191531.258815:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003117df42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630933888:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191531.258826:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191531.258855:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191531.258872:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e3e12bd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630933696:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191531.258874:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [0->1]
00000100:00100000:1.0:1776191531.258883:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba9731d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630933248:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191531.258908:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191531.258919:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191531.258929:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ad77ca4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630933760:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191531.258939:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000250a4bd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630933440:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191531.258956:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191531.258971:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191531.258991:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000150035b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630933824:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191531.258995:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630933312
00000100:00100000:1.0:1776191531.259013:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191531.259079:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630933888
00000100:00100000:1.0:1776191531.259082:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630933184
00000100:00100000:3.0:1776191531.259103:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630933440
00000100:00100000:1.0:1776191531.259115:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630933952
00000100:00100000:3.0:1776191531.259129:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630933824
00000100:00100000:3.0:1776191531.259146:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4806
00000100:00100000:3.0:1776191531.259151:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b397ad6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630933312:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191531.259194:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b397ad6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630933312:12345-0@lo:400:kworker/u8:4.0 Request processed in 41us (636us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191531.259200:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4806
00000100:00100000:3.0:1776191531.259214:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4807
00000100:00100000:3.0:1776191531.259217:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001bc0bbec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630933888:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191531.259246:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001bc0bbec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630933888:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (393us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191531.259251:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4807
00000100:00100000:3.0:1776191531.259261:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4808
00000100:00100000:3.0:1776191531.259266:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba29c9bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630933440:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191531.259288:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba29c9bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630933440:12345-0@lo:400:kworker/u8:4.0 Request processed in 21us (319us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191531.259294:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4808
00000100:00100000:3.0:1776191531.259302:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4809
00000100:00100000:3.0:1776191531.259305:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007c94492b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630933824:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191531.259324:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007c94492b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630933824:12345-0@lo:400:kworker/u8:4.0 Request processed in 18us (313us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191531.259330:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4809
00000100:00100000:3.0:1776191531.259352:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630933568
00000100:00100000:1.0:1776191531.259364:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1649
00000100:00100000:1.0:1776191531.259371:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000054825189 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630933184:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191531.259375:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630933696
00000100:00100000:3.0:1776191531.259388:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630933760
00002000:00000024:1.0:1776191531.259394:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191531.259403:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2077
00000100:00100000:3.0:1776191531.259409:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc6c4887 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630933568:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191531.259428:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000054825189 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630933184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (1041us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191531.259445:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc6c4887 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630933568:12345-0@lo:400:kworker/u8:4.0 Request processed in 34us (842us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191531.259446:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1649
00000100:00100000:3.0:1776191531.259456:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2077
00000100:00100000:1.0:1776191531.259464:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1650
00000100:00100000:1.0:1776191531.259469:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a4473266 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630933952:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191531.259473:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2386
00000100:00100000:3.0:1776191531.259478:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000069339e29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630933696:12345-0@lo:8:kworker/u8:4.0
00002000:00000024:1.0:1776191531.259480:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191531.259515:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a4473266 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630933952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (871us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191531.259521:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1650
00000100:00100000:2.0:1776191531.259540:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630933504
00010000:02020000:3.0:1776191531.259569:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191531.259571:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3271
00000100:00100000:2.0:1776191531.259579:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000051b7dfa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630933504:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191531.259582:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2387
00000100:00100000:1.0:1776191531.259588:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000038c94349 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630933760:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191531.259611:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000069339e29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630933696:12345-0@lo:8:kworker/u8:4.0 Request processed in 130us (702us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191531.259618:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2386
00000100:00100000:2.0:1776191531.259627:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000051b7dfa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630933504:12345-0@lo:400:kworker/u8:4.0 Request processed in 48us (1156us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191531.259635:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3271
00000100:00080000:3.0:1776191531.259662:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191531.259667:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191531.259672:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e3e12bd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630933696:0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191531.259677:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191531.259712:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000250a4bd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630933440:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191531.259717:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000038c94349 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630933760:12345-0@lo:8:kworker/u8:4.0 Request processed in 127us (760us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191531.259726:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2387
00000100:00080000:1.0:1776191531.259957:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191531.259961:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191531.259965:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ad77ca4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630933760:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191531.260418:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630933248
00000100:00100000:1.0:1776191531.260676:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1800
00000100:00100000:1.0:1776191531.260680:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000351c4067 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630933248:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191531.260721:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000351c4067 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630933248:12345-0@lo:400:kworker/u8:4.0 Request processed in 40us (1804us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191531.260728:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1800
00000100:00100000:3.0:1776191531.260832:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000150035b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630933824:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191531.260854:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003117df42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630933888:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191531.260863:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000061ace3cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630933504:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191531.260877:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7c3b55d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630933184:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191531.260907:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba9731d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630933248:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191531.261240:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a0f2d502 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630933632:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191531.261266:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630933376
00000100:00100000:0.0:1776191531.261274:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191531.261309:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048d62137 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630933312:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191531.261325:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011caeb27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630933568:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191531.261337:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6387b57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630933952:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191531.261354:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3272
00000100:00100000:2.0:1776191531.261362:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c31912e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630933376:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191531.261373:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630933632
00000100:00100000:2.0:1776191531.261404:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c31912e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630933376:12345-0@lo:400:kworker/u8:4.0 Request processed in 43us (2674us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191531.261415:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3272
00000100:00100000:1.0:1776191531.261416:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2078
00000100:00100000:1.0:1776191531.261422:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005783e1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630933632:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191531.261464:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005783e1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630933632:12345-0@lo:400:kworker/u8:4.0 Request processed in 41us (191us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191531.261470:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2078
00000100:00100000:0.0:1776191531.261633:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c4e82865 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630933376:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191531.261644:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a0f2d502 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630933632:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191532.026286:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191532.893239:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191532.893287:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191532.893488:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613806080
00000100:00100000:3.0:1776191532.893490:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191532.893531:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191532.893557:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1801
00000100:00100000:3.0:1776191532.893562:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191532.893569:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048ed839b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613806080:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191532.893617:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613806272
00000100:00100000:3.0:1776191532.893646:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613806336
00000100:00100000:3.0:1776191532.893663:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2079
00000100:00100000:3.0:1776191532.893668:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e61c6045 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613806272:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191532.893738:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613806208
00000100:00100000:0.0:1776191532.893766:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613806144
00000100:00100000:0.0:1776191532.893784:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4810
00000100:00100000:0.0:1776191532.893788:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000f2c1983 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613806208:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191532.893845:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048ed839b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613806080:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 277us (614us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191532.893853:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1801
00000100:00100000:1.0:1776191532.893891:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4811
00000100:00100000:1.0:1776191532.893896:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000005638afb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613806144:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191532.894014:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2388
00000100:00100000:2.0:1776191532.894019:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ecc8f95b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613806336:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00000100:00100000:3.0:1776191532.894174:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e61c6045 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613806272:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 505us (644us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191532.894182:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2079
00010000:02020000:2.0:1776191532.896442:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191532.896535:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ecc8f95b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613806336:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 2513us (2975us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191532.896548:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2388
00000100:00100000:0.0:1776191532.897150:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000f2c1983 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613806208:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 3357us (3859us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191532.897161:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4810
00000100:00100000:1.0:1776191532.899143:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000005638afb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613806144:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 5239us (5647us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191532.899157:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4811
00010000:00010000:3.0:1776191533.050318:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191534.076051:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191534.330747:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191534.330773:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000041c7ca25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630934016:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191534.330836:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191534.331075:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630934016
00000100:00100000:2.0:1776191534.331127:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3273
00000100:00100000:2.0:1776191534.331132:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd188b2d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630934016:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191534.331329:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191534.331384:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd188b2d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630934016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 251us (549us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191534.331392:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3273
00000100:00100000:0.0:1776191534.331974:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000041c7ca25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630934016:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191535.098813:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191535.354335:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191535.354360:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630934080:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191535.354427:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191535.354575:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630934080
00000100:00100000:1.0:1776191535.354624:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3274
00000100:00100000:1.0:1776191535.354631:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007c618fbc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630934080:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191535.354751:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191535.354803:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007c618fbc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630934080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 171us (376us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191535.354813:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3274
00000100:00100000:0.0:1776191535.355157:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630934080:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191536.126697:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191536.378285:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776191536.378307:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000081285d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630934144:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191536.378378:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1776191536.378567:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191536.378571:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191536.378574:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191536.378580:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4069
00000100:00080000:3.0:1776191536.378584:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191536.378589:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191536.378592:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a18fdc4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630934208:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191536.378610:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000069339e29 x1862467630934592/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191536.378632:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1776191536.378634:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191536.378638:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191536.378640:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191536.378643:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4069
00000100:00080000:3.0:1776191536.378646:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191536.378649:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191536.378663:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000003117df42 x1862467630934656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191536.378666:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000019361fa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630934464:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191536.378703:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191536.378717:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000056503154 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630934272:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191536.378754:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003f51e2bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630934400:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191536.378756:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191536.378785:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c2f2cb97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630934528:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191536.378791:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191536.378810:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630934144
00000100:00100000:1.0:1776191536.378853:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1651
00000100:00100000:1.0:1776191536.378860:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016dc0009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630934144:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191536.378885:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630934208
00002000:00000024:1.0:1776191536.378889:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191536.378925:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1802
00000100:00100000:2.0:1776191536.378929:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000062c92fc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630934208:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191536.380302:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191536.380337:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1776191536.380346:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dfe84e20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630934848:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191536.380383:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191536.380427:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630934464
00000100:00100000:3.0:1776191536.380463:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3275
00000100:00100000:3.0:1776191536.380468:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000023fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630934464:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191536.380510:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000023fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630934464:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (1810us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191536.380517:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3275
00000100:00100000:3.0:1776191536.380540:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630934272
00000100:00100000:3.0:1776191536.380562:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630934400
00000100:00100000:3.0:1776191536.380580:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4812
00000100:00100000:3.0:1776191536.380584:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005be56c88 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630934272:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191536.380617:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005be56c88 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630934272:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (1865us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191536.380753:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4812
00000100:00100000:3.0:1776191536.380765:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4813
00000100:00100000:3.0:1776191536.380769:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000fc0c826 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630934400:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191536.380799:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000fc0c826 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630934400:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (2013us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191536.380805:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4813
00000100:00100000:3.0:1776191536.380829:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630934528
00000100:00100000:3.0:1776191536.380851:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2080
00000100:00100000:3.0:1776191536.380854:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007416a516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630934528:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191536.380885:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007416a516 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630934528:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (586us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191536.380889:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2080
00000100:00100000:3.0:1776191536.380943:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000056503154 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630934272:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191536.380952:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c2f2cb97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630934528:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191536.380995:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003570f9a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630934336:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191536.381019:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191536.381125:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000150035b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630934720:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191536.381148:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191536.381175:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630934720
00000100:00100000:3.0:1776191536.381199:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4814
00000100:00100000:3.0:1776191536.381204:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d6586537 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630934720:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191536.381237:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d6586537 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630934720:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (89us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191536.381242:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4814
00000100:00100000:3.0:1776191536.381256:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630934336
00000100:00100000:3.0:1776191536.381271:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3276
00000100:00100000:3.0:1776191536.381274:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070835139 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630934336:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191536.381297:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070835139 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630934336:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (279us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191536.381303:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3276
00000100:00100000:3.0:1776191536.381334:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000019361fa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630934464:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191536.381358:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003570f9a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630934336:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191536.381365:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000150035b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630934720:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191536.381406:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630934848
00000100:00100000:3.0:1776191536.381426:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1652
00000100:00100000:3.0:1776191536.381430:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000259772a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630934848:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191536.381442:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191536.381472:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000259772a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630934848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (1090us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191536.381478:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1652
00000100:00100000:3.0:1776191536.381496:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000069339e29 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630934592:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191536.381519:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191536.381532:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003117df42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630934656:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191536.381550:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191536.381578:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630934592
00000100:00100000:0.0:1776191536.381597:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003f51e2bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630934400:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191536.381597:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630934656
00000100:00100000:0.0:1776191536.381608:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ad77ca4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630934784:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191536.381614:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2389
00000100:00100000:3.0:1776191536.381619:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000150035b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630934592:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191536.382230:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191536.382273:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000150035b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630934592:12345-0@lo:8:kworker/u8:2.0 Request processed in 652us (754us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191536.382281:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2389
00000100:00100000:3.0:1776191536.382296:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2390
00000100:00100000:3.0:1776191536.382300:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005fd6c919 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630934656:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191536.382378:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191536.382403:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005fd6c919 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630934656:12345-0@lo:8:kworker/u8:2.0 Request processed in 102us (852us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191536.382408:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2390
00000100:00080000:3.0:1776191536.382444:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191536.382448:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191536.382451:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000069339e29 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630934592:0@lo:8:kworker/u8:2.0
00000100:00080000:3.0:1776191536.382459:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191536.382461:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191536.382463:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003117df42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630934656:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191536.382495:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dfe84e20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630934848:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191536.382772:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191536.382874:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630934784
00000100:00100000:3.0:1776191536.382909:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4815
00000100:00100000:3.0:1776191536.382922:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000939da0e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630934784:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191536.382963:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000939da0e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630934784:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (1329us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191536.382969:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4815
00000100:00100000:0.0:1776191536.383176:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ad77ca4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630934784:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191536.384671:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000062c92fc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630934208:12345-0@lo:400:kworker/u8:2.0 Request processed in 5735us (6035us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191536.384684:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1802
00000100:00100000:2.0:1776191536.384753:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a18fdc4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630934208:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191536.397730:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016dc0009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630934144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 18862us (19346us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191536.397745:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1651
00000100:00100000:2.0:1776191536.397888:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000081285d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630934144:0@lo:13:osp-pre-0-0.0
00010000:00010000:0.0:1776191537.149484:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191538.011330:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191538.011428:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191538.011474:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191538.011505:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191538.011564:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613806656
00000100:00100000:1.0:1776191538.011605:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2391
00000100:00100000:1.0:1776191538.011612:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000baaea16f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613806656:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:1.0:1776191538.011719:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191538.011785:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000baaea16f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613806656:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 173us (357us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191538.011792:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2391
00000100:00100000:2.0:1776191538.014387:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613806400
00000100:00100000:2.0:1776191538.014464:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1803
00000100:00100000:2.0:1776191538.014471:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c45da90d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613806400:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191538.014543:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c45da90d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613806400:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 71us (3068us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191538.014550:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1803
00000100:00100000:3.0:1776191538.019057:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191538.019190:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613806592
00000100:00100000:1.0:1776191538.019256:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2081
00000100:00100000:1.0:1776191538.019264:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027f5d17c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613806592:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191538.019349:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027f5d17c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613806592:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 84us (316us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191538.019368:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2081
00000100:00100000:0.0:1776191538.023217:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613806464
00000100:00100000:2.0:1776191538.023244:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613806528
00000100:00100000:0.0:1776191538.023370:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4816
00000100:00100000:0.0:1776191538.023377:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003117df42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613806464:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191538.023479:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003117df42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613806464:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 101us (12155us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191538.023488:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4816
00000100:00100000:0.0:1776191538.023506:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4817
00000100:00100000:0.0:1776191538.023511:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000039ed90c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613806528:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191538.023534:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000039ed90c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613806528:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 22us (12029us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191538.023540:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4817
00010000:00010000:3.0:1776191538.170265:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191539.196650:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191539.451320:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e555734e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630934912:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191539.451407:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191539.451478:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630934912
00000100:00100000:3.0:1776191539.451533:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3277
00000100:00100000:3.0:1776191539.451540:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ec42a12f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630934912:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191539.451573:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191539.452137:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ec42a12f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630934912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 594us (728us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191539.452147:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3277
00000100:00100000:2.0:1776191539.454763:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e555734e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630934912:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191540.218268:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191540.474364:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191540.474389:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c4fb1a2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630934976:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191540.474456:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191540.474747:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630934976
00000100:00100000:3.0:1776191540.474792:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3278
00000100:00100000:3.0:1776191540.474798:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc6c4887 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630934976:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191540.474838:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191540.474975:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc6c4887 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630934976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 176us (520us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191540.474982:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3278
00000100:00100000:0.0:1776191540.479167:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c4fb1a2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630934976:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191541.246390:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191541.498949:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000081285d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630935040:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191541.499030:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191541.499215:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630935040
00000100:00100000:1.0:1776191541.499269:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1653
00000100:00100000:1.0:1776191541.499275:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e555734e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630935040:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191541.499304:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191541.499352:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e555734e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630935040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (323us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191541.499359:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1653
00000100:00080000:0.0:1776191541.499929:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191541.499935:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191541.499938:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191541.499943:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4074
00000100:00080000:0.0:1776191541.499946:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191541.499950:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191541.499969:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000f50805c6 x1862467630935488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191541.499981:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191541.499984:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191541.499986:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191541.499988:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4074
00000100:00080000:0.0:1776191541.499990:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191541.499993:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191541.500015:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000009d858fae x1862467630935552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191541.500118:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000009501226 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630935168:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191541.500152:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191541.500173:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000098ff6e13 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630935424:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191541.500193:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191541.500208:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:0.0:1776191541.500212:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000118d0482 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630935104:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191541.500240:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191541.500255:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023d9198f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630935360:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191541.500274:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191541.500301:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630935168
00000100:00100000:0.0:1776191541.500332:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4818
00000100:00100000:0.0:1776191541.500336:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000039f9568 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630935168:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191541.500373:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000039f9568 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630935168:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (220us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191541.500379:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4818
00000100:00100000:0.0:1776191541.500399:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630935104
00000100:00100000:0.0:1776191541.500422:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1804
00000100:00100000:0.0:1776191541.500426:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002aaf4bb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630935104:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191541.500453:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002aaf4bb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630935104:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (213us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191541.500458:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1804
00000100:00100000:0.0:1776191541.500510:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000118d0482 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630935104:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191541.500524:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000009501226 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630935168:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191541.500782:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000417ffd59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630935296:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191541.500822:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191541.500841:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000020784d50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630935680:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191541.500860:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191541.500883:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000081285d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630935040:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191541.500899:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:2.0:1776191541.500903:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000090a9e988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630935232:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191541.500921:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191541.500932:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c3a79bd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630935616:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191541.500949:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191541.500969:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630935296
00000100:00100000:2.0:1776191541.500988:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630935680
00000100:00100000:2.0:1776191541.501086:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630935616
00000100:00100000:2.0:1776191541.501105:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4819
00000100:00100000:2.0:1776191541.501109:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dfe84e20 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630935296:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191541.501142:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dfe84e20 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630935296:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (319us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191541.501147:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4819
00000100:00100000:2.0:1776191541.501158:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4820
00000100:00100000:2.0:1776191541.501161:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000041c7ca25 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630935680:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191541.501182:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000041c7ca25 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630935680:12345-0@lo:400:kworker/u8:2.0 Request processed in 20us (321us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191541.501186:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4820
00000100:00100000:2.0:1776191541.501194:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4821
00000100:00100000:2.0:1776191541.501197:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006776e411 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630935616:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191541.501215:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006776e411 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630935616:12345-0@lo:400:kworker/u8:2.0 Request processed in 17us (266us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191541.501220:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4821
00000100:00100000:2.0:1776191541.501242:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c3a79bd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630935616:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191541.501250:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000417ffd59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630935296:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191541.501257:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000020784d50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630935680:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191541.501369:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f50805c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630935488:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191541.501400:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191541.501424:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009d858fae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630935552:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191541.501444:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191541.501471:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630935424
00000100:00100000:3.0:1776191541.503246:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630935488
00000100:00100000:3.0:1776191541.503308:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630935552
00000100:00100000:3.0:1776191541.503331:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2082
00000100:00100000:3.0:1776191541.503339:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be32aae2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630935424:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191541.503420:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be32aae2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630935424:12345-0@lo:400:kworker/u8:2.0 Request processed in 82us (3225us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191541.503427:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2082
00000100:00100000:3.0:1776191541.503443:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2392
00000100:00100000:3.0:1776191541.503447:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3e12bd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630935488:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191541.503655:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000098ff6e13 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630935424:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191541.503737:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2393
00000100:00100000:0.0:1776191541.503741:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ad77ca4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630935552:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191541.503832:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191541.503867:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ad77ca4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630935552:12345-0@lo:8:kworker/u8:2.0 Request processed in 126us (2423us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191541.503876:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2393
00000100:00100000:1.0:1776191541.504943:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630935360
00000100:00100000:1.0:1776191541.504991:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630935232
00000100:00100000:1.0:1776191541.505018:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3279
00000100:00100000:1.0:1776191541.505023:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a5f06cb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630935360:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191541.505108:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a5f06cb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630935360:12345-0@lo:400:kworker/u8:2.0 Request processed in 84us (4834us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191541.505115:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3279
00000100:00100000:1.0:1776191541.505129:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3280
00000100:00100000:1.0:1776191541.505133:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f74cc947 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630935232:12345-0@lo:400:kworker/u8:2.0
00000100:00080000:2.0:1776191541.505327:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191541.505333:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191541.505337:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009d858fae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630935552:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191541.505438:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f74cc947 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630935232:12345-0@lo:400:kworker/u8:2.0 Request processed in 304us (4515us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191541.505444:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3280
00010000:02020000:3.0:1776191541.505695:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191541.505739:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3e12bd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630935488:12345-0@lo:8:kworker/u8:2.0 Request processed in 2291us (4338us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191541.505745:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2392
00000100:00100000:2.0:1776191541.506468:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000090a9e988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630935232:0@lo:400:kworker/u8:2.0
00000100:00080000:1.0:1776191541.506629:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191541.506633:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191541.506637:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f50805c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630935488:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191541.507711:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c02746a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630935744:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191541.507787:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191541.507882:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023d9198f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630935360:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191541.509521:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630935744
00000100:00100000:3.0:1776191541.509599:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1654
00000100:00100000:3.0:1776191541.509606:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000098ff6e13 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630935744:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191541.509636:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191541.509719:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000098ff6e13 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630935744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (1932us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191541.509725:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1654
00000100:00100000:0.0:1776191541.510077:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c02746a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630935744:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1776191542.266376:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191543.130483:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191543.130528:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191543.130572:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191543.130608:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191543.130642:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191543.130682:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613806720
00000100:00100000:3.0:1776191543.130727:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1805
00000100:00100000:3.0:1776191543.130735:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027ca70f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613806720:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191543.130810:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027ca70f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613806720:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 75us (201us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191543.130822:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1805
00000100:00100000:0.0:1776191543.131336:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613806976
00000100:00100000:0.0:1776191543.131377:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613806912
00000100:00100000:0.0:1776191543.131404:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2083
00000100:00100000:0.0:1776191543.131409:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000069339e29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613806912:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191543.131458:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000069339e29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613806912:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 49us (895us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191543.131465:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2083
00000100:00100000:0.0:1776191543.131479:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2394
00000100:00100000:0.0:1776191543.131482:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003f51e2bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613806976:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:0.0:1776191543.131747:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191543.131787:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003f51e2bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613806976:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 303us (1260us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191543.131795:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2394
00000100:00100000:0.0:1776191543.131819:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613806784
00000100:00100000:0.0:1776191543.131845:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613806848
00000100:00100000:0.0:1776191543.131862:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4822
00000100:00100000:0.0:1776191543.131866:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a18fdc4f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613806784:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191543.131894:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a18fdc4f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613806784:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 27us (1419us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191543.131900:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4822
00000100:00100000:0.0:1776191543.131911:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4823
00000100:00100000:0.0:1776191543.131915:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003570f9a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613806848:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191543.131935:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003570f9a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613806848:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 20us (1294us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191543.131940:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4823
00010000:00010000:0.0:1776191543.292635:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191544.314321:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191544.570424:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e2ce3f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630935808:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191544.570492:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191544.570614:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630935808
00000100:00100000:3.0:1776191544.570669:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3281
00000100:00100000:3.0:1776191544.570675:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000023d9198f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630935808:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191544.570709:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191544.570771:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000023d9198f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630935808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (279us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191544.570778:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3281
00000100:00100000:0.0:1776191544.571195:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e2ce3f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630935808:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191545.340076:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191545.595742:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009df06d88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630935872:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191545.595806:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191545.596064:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630935872
00000100:00100000:1.0:1776191545.596115:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3282
00000100:00100000:1.0:1776191545.596123:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019361fa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630935872:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191545.596159:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191545.596219:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019361fa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630935872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (413us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191545.596225:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3282
00000100:00100000:2.0:1776191545.596344:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009df06d88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630935872:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191546.362503:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191546.618204:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e486c123 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630935936:0@lo:400:kworker/u8:2.0
00000100:00080000:2.0:1776191546.618218:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191546.618222:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191546.618225:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191546.618230:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4079
00000100:00080000:2.0:1776191546.618232:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191546.618237:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191546.618254:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000005e2ce3f1 x1862467630936448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191546.618266:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191546.618269:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191546.618270:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1776191546.618272:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1776191546.618272:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4079
00000100:00080000:2.0:1776191546.618274:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191546.618277:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191546.618286:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000090a9e988 x1862467630936512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191546.618294:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057916d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630936000:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191546.618317:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000af393e55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630936192:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191546.618318:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191546.618339:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ec90674 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630936256:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191546.618344:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191546.618360:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191546.618371:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000118d0482 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630936640:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191546.618389:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191546.618423:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630936192
00000100:00100000:0.0:1776191546.618458:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630936640
00000100:00100000:0.0:1776191546.618479:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4824
00000100:00100000:0.0:1776191546.618485:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000417ffd59 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630936192:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191546.618531:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000417ffd59 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630936192:12345-0@lo:400:kworker/u8:2.0 Request processed in 45us (186us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191546.618538:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4824
00000100:00100000:0.0:1776191546.618553:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4825
00000100:00100000:0.0:1776191546.618557:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad5119bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630936640:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191546.618587:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad5119bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630936640:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (197us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191546.618593:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4825
00000100:00100000:0.0:1776191546.618618:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630936000
00000100:00100000:0.0:1776191546.618638:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1655
00000100:00100000:0.0:1776191546.618641:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d5b0551d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630936000:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191546.618660:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191546.618687:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d5b0551d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630936000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (369us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191546.618704:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1655
00000100:00100000:0.0:1776191546.618897:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630935936
00000100:00100000:0.0:1776191546.618920:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1806
00000100:00100000:0.0:1776191546.618923:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb953a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630935936:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191546.618953:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb953a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630935936:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (681us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191546.618959:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1806
00000100:00100000:0.0:1776191546.618997:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000118d0482 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630936640:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191546.619007:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e486c123 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630935936:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191546.619020:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057916d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630936000:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191546.619070:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000640b7818 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630936128:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191546.619093:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191546.619107:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000950cd033 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630936384:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191546.619127:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191546.619142:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:0.0:1776191546.619146:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000263400d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630936064:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191546.619163:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191546.619176:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e72cee95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630936320:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191546.619193:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191546.619220:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630936064
00000100:00100000:0.0:1776191546.619241:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4826
00000100:00100000:0.0:1776191546.619245:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000522261df pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630936064:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191546.619276:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000522261df pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630936064:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (112us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191546.619282:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4826
00000100:00100000:0.0:1776191546.619306:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000263400d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630936064:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191546.619337:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630936384
00000100:00100000:0.0:1776191546.619359:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630936320
00000100:00100000:0.0:1776191546.619373:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2084
00000100:00100000:0.0:1776191546.619377:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a11d504 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630936384:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191546.619407:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a11d504 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630936384:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (280us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191546.619413:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2084
00000100:00100000:0.0:1776191546.619423:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2085
00000100:00100000:0.0:1776191546.619426:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ed05c09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630936320:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191546.619450:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ed05c09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630936320:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (257us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191546.619456:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2085
00000100:00100000:2.0:1776191546.619467:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000009501226 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630936576:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191546.619483:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e72cee95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630936320:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191546.619491:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000950cd033 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630936384:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191546.619634:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e2ce3f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630936448:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191546.619665:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191546.619680:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000090a9e988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630936512:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191546.619710:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191546.619737:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630936448
00000100:00100000:1.0:1776191546.619753:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630936512
00000100:00100000:1.0:1776191546.619767:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2395
00000100:00100000:1.0:1776191546.619770:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000418a6d34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630936448:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:1.0:1776191546.619859:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191546.619860:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191546.619889:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000af393e55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630936192:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191546.619890:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000418a6d34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630936448:12345-0@lo:8:kworker/u8:2.0 Request processed in 119us (225us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191546.619896:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2395
00000100:00100000:1.0:1776191546.619906:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2396
00000100:00100000:1.0:1776191546.619910:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009189961c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630936512:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:1.0:1776191546.619989:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191546.620011:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009189961c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630936512:12345-0@lo:8:kworker/u8:2.0 Request processed in 101us (301us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191546.620017:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2396
00000100:00100000:1.0:1776191546.620058:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630936576
00000100:00100000:1.0:1776191546.620083:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4827
00000100:00100000:1.0:1776191546.620086:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000118d0482 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630936576:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191546.620118:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000118d0482 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630936576:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (259us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191546.620124:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4827
00000100:00080000:1.0:1776191546.620146:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191546.620150:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191546.620153:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e2ce3f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630936448:0@lo:8:kworker/u8:2.0
00000100:00080000:1.0:1776191546.620159:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191546.620162:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191546.620164:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000090a9e988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630936512:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191546.620189:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630936256
00000100:00100000:1.0:1776191546.620204:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630936128
00000100:00100000:2.0:1776191546.620210:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000009501226 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630936576:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191546.620214:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3283
00000100:00100000:1.0:1776191546.620217:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e8472586 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630936256:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191546.620237:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1776191546.620243:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000161dca59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630936704:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191546.620249:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e8472586 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630936256:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (1889us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191546.620255:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3283
00000100:00100000:1.0:1776191546.620265:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3284
00000100:00100000:1.0:1776191546.620269:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000057916d34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630936128:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191546.620269:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191546.620294:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630936704
00000100:00100000:1.0:1776191546.620296:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000057916d34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630936128:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (1203us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191546.620301:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3284
00000100:00100000:2.0:1776191546.620312:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1656
00000100:00100000:2.0:1776191546.620316:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009501226 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630936704:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191546.620324:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ec90674 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630936256:0@lo:400:kworker/u8:2.0
00002000:00000024:2.0:1776191546.620326:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191546.620352:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009501226 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630936704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (82us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191546.620358:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1656
00000100:00100000:3.0:1776191546.620733:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000161dca59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630936704:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191546.620745:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000640b7818 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630936128:0@lo:400:kworker/u8:2.0
00010000:00010000:3.0:1776191547.386407:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191548.253243:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191548.253286:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191548.253319:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191548.253357:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191548.253439:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613807168
00000100:00100000:2.0:1776191548.253485:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613807104
00000100:00100000:2.0:1776191548.253502:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4828
00000100:00100000:2.0:1776191548.253508:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c2f2cb97 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613807168:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191548.253537:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613807040
00000100:00100000:0.0:1776191548.253573:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1807
00000100:00100000:0.0:1776191548.253579:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a5cfa2a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613807040:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191548.253588:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c2f2cb97 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613807168:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 77us (301us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191548.253602:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4828
00000100:00100000:0.0:1776191548.253614:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a5cfa2a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613807040:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 34us (378us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191548.253624:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1807
00000100:00100000:2.0:1776191548.253627:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4829
00000100:00100000:2.0:1776191548.253637:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000056503154 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613807104:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191548.253677:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000056503154 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613807104:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 43us (358us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191548.253683:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4829
00000100:00100000:3.0:1776191548.254224:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191548.259796:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613807232
00000100:00100000:1.0:1776191548.259873:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613807296
00000100:00100000:1.0:1776191548.259974:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2086
00000100:00100000:1.0:1776191548.259981:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cfc3317d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613807232:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191548.260079:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cfc3317d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613807232:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 97us (6721us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191548.260087:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2086
00000100:00100000:1.0:1776191548.260107:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2397
00000100:00100000:1.0:1776191548.260111:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c200fc57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613807296:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:1.0:1776191548.260208:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191548.260236:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c200fc57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613807296:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 124us (6014us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191548.260243:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2397
00010000:00010000:3.0:1776191548.410506:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191549.434261:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191549.693002:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000cc4c333 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630936768:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191549.693100:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191549.693209:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630936768
00000100:00100000:3.0:1776191549.693265:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3285
00000100:00100000:3.0:1776191549.693279:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000098ff6e13 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630936768:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191549.693313:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191549.693365:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000098ff6e13 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630936768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (266us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191549.693372:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3285
00000100:00100000:1.0:1776191549.693603:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000cc4c333 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630936768:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191550.458515:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191550.714746:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191550.714767:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009df06d88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630936832:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191550.714833:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191550.714931:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630936832
00000100:00100000:1.0:1776191550.714980:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3286
00000100:00100000:1.0:1776191550.714985:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000852fcdad pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630936832:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191550.715016:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191550.715086:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000852fcdad pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630936832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (253us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191550.715093:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3286
00000100:00100000:0.0:1776191550.715356:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009df06d88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630936832:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191551.482423:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191551.738593:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c4fb1a2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630936960:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191551.738670:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191551.738750:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776191551.738759:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c02746a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630936896:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191551.738790:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191551.738884:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191551.738889:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191551.738892:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191551.738897:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4084
00000100:00080000:1.0:1776191551.738899:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191551.738905:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191551.738925:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000c9cf495d x1862467630937408/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191551.738940:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191551.738944:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191551.738945:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191551.738948:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4084
00000100:00100000:3.0:1776191551.738949:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009df06d88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630937024:0@lo:400:kworker/u8:4.0
00000100:00080000:1.0:1776191551.738950:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191551.738952:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191551.738962:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000007cae42a8 x1862467630937472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191551.738982:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191551.738992:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9cf495d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630937408:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191551.738997:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000039ea1fd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630937280:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191551.739017:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191551.739018:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191551.739046:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007cae42a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630937472:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191551.739047:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:3.0:1776191551.739052:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae6c8b4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630937216:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191551.739067:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191551.739072:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191551.739083:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f43f1e37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630937600:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191551.739098:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630937408
00000100:00100000:3.0:1776191551.739100:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191551.739123:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630937472
00000100:00100000:3.0:1776191551.739124:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630937216
00000100:00100000:1.0:1776191551.739139:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2398
00000100:00100000:1.0:1776191551.739145:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ed42626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630937408:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191551.739149:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630937600
00000100:00100000:3.0:1776191551.739164:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4830
00000100:00100000:3.0:1776191551.739167:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004831c73f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630937216:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191551.739222:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004831c73f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630937216:12345-0@lo:400:kworker/u8:4.0 Request processed in 53us (149us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191551.739229:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4830
00010000:02020000:1.0:1776191551.739241:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191551.739245:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4831
00000100:00100000:3.0:1776191551.739248:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f17e505c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630937600:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191551.739267:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f17e505c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630937600:12345-0@lo:400:kworker/u8:4.0 Request processed in 19us (166us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191551.739273:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4831
00000100:00100000:1.0:1776191551.739284:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ed42626 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630937408:12345-0@lo:8:kworker/u8:4.0 Request processed in 139us (266us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191551.739290:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2398
00000100:00100000:1.0:1776191551.739301:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2399
00000100:00100000:1.0:1776191551.739304:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a81e70bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630937472:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191551.739307:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630937280
00000100:00100000:3.0:1776191551.739327:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3287
00000100:00100000:3.0:1776191551.739330:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003f4bfd6c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630937280:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191551.739355:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003f4bfd6c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630937280:12345-0@lo:400:kworker/u8:4.0 Request processed in 24us (336us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191551.739361:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3287
00000100:00100000:3.0:1776191551.739387:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae6c8b4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630937216:0@lo:400:kworker/u8:4.0
00010000:02020000:1.0:1776191551.739388:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191551.739397:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f43f1e37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630937600:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191551.739404:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000039ea1fd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630937280:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191551.739424:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a81e70bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630937472:12345-0@lo:8:kworker/u8:4.0 Request processed in 118us (357us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191551.739430:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2399
00000100:00080000:1.0:1776191551.739457:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191551.739460:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191551.739464:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9cf495d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630937408:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191551.739464:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009eabfd74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630937152:0@lo:400:kworker/u8:4.0
00000100:00080000:1.0:1776191551.739471:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191551.739473:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191551.739475:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007cae42a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630937472:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191551.739487:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191551.739499:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009065a894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630937536:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191551.739502:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630937024
00000100:00100000:1.0:1776191551.739525:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1808
00000100:00100000:1.0:1776191551.739529:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c7de7df8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630937024:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191551.739529:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191551.739543:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:3.0:1776191551.739548:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000161dca59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630937088:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191551.739566:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191551.739574:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c7de7df8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630937024:12345-0@lo:400:kworker/u8:4.0 Request processed in 32us (581us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191551.739586:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e80ba0d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630937344:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191551.739589:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1808
00000100:00100000:3.0:1776191551.739605:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191551.739622:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009df06d88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630937024:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191551.739623:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630937344
00000100:00100000:3.0:1776191551.739646:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2087
00000100:00100000:3.0:1776191551.739650:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007cae42a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630937344:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191551.739693:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007cae42a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630937344:12345-0@lo:400:kworker/u8:4.0 Request processed in 42us (88us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191551.739700:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2087
00000100:00100000:3.0:1776191551.739721:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630937536
00000100:00100000:3.0:1776191551.739739:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630937088
00000100:00100000:3.0:1776191551.739753:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4832
00000100:00100000:3.0:1776191551.739757:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f5a166e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630937536:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191551.739797:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f5a166e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630937536:12345-0@lo:400:kworker/u8:4.0 Request processed in 39us (268us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191551.739802:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4832
00000100:00100000:3.0:1776191551.739815:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4833
00000100:00100000:3.0:1776191551.739818:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b92c4097 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630937088:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191551.739841:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b92c4097 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630937088:12345-0@lo:400:kworker/u8:4.0 Request processed in 22us (274us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191551.739846:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4833
00000100:00100000:3.0:1776191551.739867:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630937152
00000100:00100000:3.0:1776191551.739883:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3288
00000100:00100000:3.0:1776191551.739886:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a96a54e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630937152:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191551.739911:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a96a54e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630937152:12345-0@lo:400:kworker/u8:4.0 Request processed in 24us (424us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191551.739916:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3288
00000100:00100000:1.0:1776191551.741237:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000161dca59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630937088:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191551.741253:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e80ba0d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630937344:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191551.741265:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009eabfd74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630937152:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191551.741358:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009065a894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630937536:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191551.742590:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630936960
00000100:00100000:0.0:1776191551.742600:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630936896
00000100:00100000:0.0:1776191551.742653:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1657
00000100:00100000:0.0:1776191551.742658:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000cc4c333 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630936896:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191551.742692:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191551.742755:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000cc4c333 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630936896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (3964us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191551.742764:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1657
00000100:00100000:2.0:1776191551.742847:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c02746a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630936896:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191551.742908:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1658
00000100:00100000:3.0:1776191551.742913:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000079eea346 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630936960:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191551.742923:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191551.742956:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000079eea346 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630936960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (4288us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191551.742962:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1658
00000100:00100000:2.0:1776191551.743061:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c4fb1a2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630936960:0@lo:13:osp-pre-0-0.0
00010000:00010000:3.0:1776191552.508207:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191553.371318:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191553.371361:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191553.371393:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191553.371413:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613807360
00000100:00100000:3.0:1776191553.371424:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191553.371461:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613807488
00000100:00100000:1.0:1776191553.371479:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1809
00000100:00100000:1.0:1776191553.371488:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000071188990 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613807360:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191553.371500:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191553.371505:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613807424
00000100:00100000:2.0:1776191553.371533:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4834
00000100:00100000:2.0:1776191553.371538:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9cf495d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613807488:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191553.371574:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071188990 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613807360:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 85us (264us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191553.371584:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1809
00000100:00100000:2.0:1776191553.371587:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9cf495d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613807488:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 48us (225us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191553.371596:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4834
00000100:00100000:2.0:1776191553.371617:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4835
00000100:00100000:2.0:1776191553.371623:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000039ea1fd6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613807424:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191553.371626:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613807552
00000100:00100000:2.0:1776191553.371657:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000039ea1fd6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613807424:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 33us (264us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191553.371665:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613807616
00000100:00100000:2.0:1776191553.371668:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4835
00000100:00100000:0.0:1776191553.371701:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2088
00000100:00100000:0.0:1776191553.371706:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae6c8b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613807552:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191553.371736:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae6c8b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613807552:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 30us (314us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191553.371743:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2088
00000100:00100000:0.0:1776191553.371762:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2400
00000100:00100000:0.0:1776191553.371765:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009065a894 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613807616:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:0.0:1776191553.371869:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191553.371894:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009065a894 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613807616:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 127us (397us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191553.371911:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2400
00010000:00010000:3.0:1776191553.532099:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191554.554428:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191554.810310:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191554.810325:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000090a9e988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630937664:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191554.810394:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191554.810487:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630937664
00000100:00100000:3.0:1776191554.810629:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3289
00000100:00100000:3.0:1776191554.810636:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f50805c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630937664:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191554.810684:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191554.810738:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f50805c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630937664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (342us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191554.810746:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3289
00000100:00100000:2.0:1776191554.810881:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000090a9e988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630937664:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191555.578235:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191555.834339:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191555.834361:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004fd8278 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630937728:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191555.834429:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191555.834637:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630937728
00000100:00100000:1.0:1776191555.834689:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3290
00000100:00100000:1.0:1776191555.834695:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009eabfd74 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630937728:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191555.834727:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191555.834782:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009eabfd74 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630937728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (353us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191555.834789:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3290
00000100:00100000:0.0:1776191555.835030:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004fd8278 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630937728:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191556.602320:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191556.858388:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191556.858404:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000090a9e988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630937792:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191556.858483:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191556.858605:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630937792
00000100:00100000:2.0:1776191556.858654:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1659
00000100:00100000:2.0:1776191556.858670:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e80ba0d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630937792:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191556.858698:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191556.858910:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e80ba0d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630937792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 250us (428us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191556.858918:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1659
00000100:00100000:2.0:1776191556.858975:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7c3b55d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630937920:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191556.859005:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191556.859024:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1776191556.859029:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000054825189 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630937856:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191556.859069:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191556.859097:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630937920
00000100:00100000:2.0:1776191556.859123:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1810
00000100:00100000:2.0:1776191556.859128:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c42de81a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630937920:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191556.859163:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c42de81a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630937920:12345-0@lo:400:kworker/u8:4.0 Request processed in 35us (157us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191556.859170:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1810
00000100:00100000:2.0:1776191556.859217:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7c3b55d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630937920:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191556.859239:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630937856
00000100:00100000:2.0:1776191556.859259:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1660
00000100:00100000:2.0:1776191556.859263:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a133ee9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630937856:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191556.859288:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191556.859316:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a133ee9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630937856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (247us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191556.859322:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1660
00000100:00100000:2.0:1776191556.859352:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000054825189 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630937856:0@lo:13:osp-pre-0-0.0
00000100:00080000:1.0:1776191556.863234:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191556.863241:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191556.863244:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191556.863252:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4089
00000100:00080000:1.0:1776191556.863255:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191556.863261:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191556.863292:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000f7c3b55d x1862467630938240/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191556.863308:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191556.863312:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191556.863313:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191556.863315:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4089
00000100:00080000:1.0:1776191556.863317:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191556.863321:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191556.863332:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000004fd8278 x1862467630938304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191556.863378:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7c3b55d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630938240:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191556.863434:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191556.863457:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004fd8278 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630938304:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191556.863488:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191556.863542:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630938240
00000100:00100000:1.0:1776191556.863573:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630938304
00000100:00100000:1.0:1776191556.863590:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2401
00000100:00100000:1.0:1776191556.863596:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c02746a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630938240:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191556.863948:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191556.863992:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c02746a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630938240:12345-0@lo:8:kworker/u8:4.0 Request processed in 395us (558us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191556.864000:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2401
00000100:00100000:1.0:1776191556.864017:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2402
00000100:00100000:1.0:1776191556.864020:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000161dca59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630938304:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191556.864128:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191556.864152:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000161dca59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630938304:12345-0@lo:8:kworker/u8:4.0 Request processed in 131us (664us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191556.864158:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2402
00000100:00100000:1.0:1776191556.864179:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000054825189 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630938176:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191556.864204:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191556.864223:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776191556.864227:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b5928219 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630938112:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191556.864254:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191556.864493:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191556.864498:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191556.864503:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7c3b55d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630938240:0@lo:8:kworker/u8:4.0
00000100:00080000:1.0:1776191556.864513:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191556.864568:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191556.864572:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004fd8278 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630938304:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191556.864647:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630938112
00000100:00100000:3.0:1776191556.864802:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e56aacf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630938048:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191556.864847:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191556.864869:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c4fb1a2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630938432:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191556.864889:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191556.864907:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:3.0:1776191556.864912:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000019e5e056 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630937984:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191556.864931:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191556.864946:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f43f1e37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630938368:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191556.864964:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191556.864990:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630938176
00000100:00100000:3.0:1776191556.865018:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630938048
00000100:00100000:3.0:1776191556.865031:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3291
00000100:00100000:3.0:1776191556.865054:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009df06d88 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630938176:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191556.865100:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009df06d88 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630938176:12345-0@lo:400:kworker/u8:4.0 Request processed in 45us (895us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191556.865106:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3291
00000100:00100000:3.0:1776191556.865120:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3292
00000100:00100000:3.0:1776191556.865123:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000063a7a5a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630938048:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191556.865153:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000063a7a5a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630938048:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (306us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191556.865158:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3292
00000100:00100000:3.0:1776191556.865176:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630938432
00000100:00100000:3.0:1776191556.865197:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630937984
00000100:00100000:3.0:1776191556.865210:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630938368
00000100:00100000:3.0:1776191556.865229:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4836
00000100:00100000:3.0:1776191556.865232:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000097dea8b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630938432:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191556.865260:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000097dea8b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630938432:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (371us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191556.865266:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4836
00000100:00100000:3.0:1776191556.865292:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4837
00000100:00100000:3.0:1776191556.865295:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000045d4856e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630937984:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191556.865317:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000045d4856e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630937984:12345-0@lo:400:kworker/u8:4.0 Request processed in 22us (386us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191556.865322:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4837
00000100:00100000:3.0:1776191556.865332:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4838
00000100:00100000:3.0:1776191556.865335:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004aff8356 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630938368:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191556.865356:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004aff8356 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630938368:12345-0@lo:400:kworker/u8:4.0 Request processed in 21us (392us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191556.865364:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4838
00000100:00100000:3.0:1776191556.865413:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000019e5e056 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630937984:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191556.865423:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f43f1e37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630938368:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191556.865430:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e56aacf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630938048:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191556.865438:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c4fb1a2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630938432:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191556.865483:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000054825189 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630938176:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191556.867809:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4839
00000100:00100000:1.0:1776191556.867873:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000cbdfd62 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630938112:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191556.867961:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000cbdfd62 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630938112:12345-0@lo:400:kworker/u8:4.0 Request processed in 90us (3707us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191556.867968:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4839
00000100:00100000:3.0:1776191556.870015:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b5928219 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630938112:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191556.873031:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000090a9e988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630937792:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1776191557.626869:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191558.494347:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191558.494394:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191558.494446:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191558.494480:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191558.494516:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613807680
00000100:00100000:3.0:1776191558.494539:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613807744
00000100:00100000:3.0:1776191558.494583:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613807808
00000100:00100000:1.0:1776191558.494588:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1811
00000100:00100000:1.0:1776191558.494596:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc7ff80b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613807680:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191558.494609:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4840
00000100:00100000:3.0:1776191558.494614:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004bce44f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613807744:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191558.494714:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613807872
00000100:00100000:2.0:1776191558.494744:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2089
00000100:00100000:2.0:1776191558.494748:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b5928219 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613807872:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191558.494883:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc7ff80b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613807680:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 287us (436us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191558.494891:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1811
00000100:00100000:1.0:1776191558.494929:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4841
00000100:00100000:1.0:1776191558.494934:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000054825189 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613807808:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191558.502650:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004bce44f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613807744:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 8025us (8304us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191558.502651:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b5928219 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613807872:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 7899us (8254us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191558.502676:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4840
00000100:00100000:2.0:1776191558.502677:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2089
00000100:00100000:3.0:1776191558.502795:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191558.502845:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613807936
00000100:00100000:3.0:1776191558.502880:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2403
00000100:00100000:3.0:1776191558.502886:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d795279f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613807936:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:3.0:1776191558.502990:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191558.503051:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d795279f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613807936:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 146us (239us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191558.503059:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2403
00000100:00100000:1.0:1776191558.504698:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000054825189 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613807808:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 9756us (10211us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191558.504714:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4841
00010000:00010000:3.0:1776191558.650851:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191559.674824:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191559.935310:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776191559.939286:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4473266 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630938496:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191559.939361:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191559.944113:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630938496
00000100:00100000:3.0:1776191559.944815:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3293
00000100:00100000:3.0:1776191559.944823:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e56aacf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630938496:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191559.944877:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191559.944967:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e56aacf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630938496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (5605us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191559.944975:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3293
00000100:00100000:0.0:1776191559.945064:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4473266 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630938496:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191560.700055:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191560.954395:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f43f1e37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630938560:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191560.954467:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191560.954578:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630938560
00000100:00100000:1.0:1776191560.954634:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3294
00000100:00100000:1.0:1776191560.954640:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d858fae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630938560:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191560.954678:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191560.954721:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d858fae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630938560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (256us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191560.954728:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3294
00000100:00100000:0.0:1776191560.955013:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f43f1e37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630938560:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191561.722834:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191561.978673:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000019e5e056 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630938624:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191561.978747:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191561.978907:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630938624
00000100:00100000:0.0:1776191561.978946:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1812
00000100:00100000:0.0:1776191561.978952:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bcb4f46f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630938624:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191561.980934:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4473266 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630938752:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191561.980998:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191561.981064:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630938752
00000100:00100000:2.0:1776191561.981102:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1661
00000100:00100000:2.0:1776191561.981113:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000341b9800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630938752:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191561.981139:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191561.981188:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000341b9800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630938752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (191us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191561.981195:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1661
00000100:00100000:2.0:1776191561.981238:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4473266 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630938752:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191561.981262:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1776191561.981271:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004fd8278 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630938816:0@lo:400:kworker/u8:2.0
00000100:00080000:1.0:1776191561.981298:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191561.981304:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1776191561.981305:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191561.981308:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191561.981315:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4094
00000100:00080000:1.0:1776191561.981317:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191561.981322:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191561.981332:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000038340710 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630939008:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191561.981343:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000c4e82865 x1862467630939136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191561.981369:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191561.981371:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191561.981375:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191561.981377:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191561.981381:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4094
00000100:00080000:1.0:1776191561.981384:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191561.981387:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191561.981394:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1776191561.981400:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000048d62137 x1862467630939200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191561.981403:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c904ec5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630939072:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191561.981439:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191561.981457:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c4e82865 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630939136:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191561.981463:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bcb4f46f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630938624:12345-0@lo:400:kworker/u8:2.0 Request processed in 2508us (2715us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191561.981474:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1812
00000100:00100000:3.0:1776191561.981489:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000019e5e056 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630938624:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191561.981510:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7c3b55d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630938880:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191561.981547:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191561.981566:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048d62137 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630939200:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191561.981592:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191561.981597:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630938816
00000100:00100000:1.0:1776191561.981627:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630939072
00000100:00100000:2.0:1776191561.981635:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4842
00000100:00100000:2.0:1776191561.981641:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008cb50901 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630938816:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191561.981660:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630939136
00000100:00100000:1.0:1776191561.981681:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630939200
00000100:00100000:3.0:1776191561.981686:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191561.981691:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008cb50901 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630938816:12345-0@lo:400:kworker/u8:2.0 Request processed in 48us (385us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191561.981699:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4842
00000100:00100000:1.0:1776191561.981704:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2090
00000100:00100000:0.0:1776191561.981708:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630939008
00000100:00100000:1.0:1776191561.981711:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004be80615 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630939072:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191561.981717:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba9731d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630939264:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191561.981725:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2404
00000100:00100000:2.0:1776191561.981731:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004da0b0e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630939136:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191561.981736:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630938880
00000100:00100000:1.0:1776191561.981751:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004be80615 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630939072:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (312us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191561.981753:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3295
00000100:00100000:0.0:1776191561.981759:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c1011c34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630939008:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191561.981764:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2090
00000100:00100000:1.0:1776191561.981782:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2405
00000100:00100000:1.0:1776191561.981786:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa41a1c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630939200:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191561.981794:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c1011c34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630939008:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (435us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191561.981800:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3295
00000100:00100000:0.0:1776191561.981811:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3296
00000100:00100000:0.0:1776191561.981814:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b847a9ef pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630938880:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191561.981832:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b847a9ef pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630938880:12345-0@lo:400:kworker/u8:2.0 Request processed in 18us (150us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191561.981837:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3296
00000100:00100000:3.0:1776191561.981881:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:02020000:2.0:1776191561.981889:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191561.981902:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630939264
00000100:00100000:3.0:1776191561.981914:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7c3b55d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630938880:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191561.981928:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4843
00000100:00100000:2.0:1776191561.981930:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004da0b0e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630939136:12345-0@lo:8:kworker/u8:2.0 Request processed in 199us (384us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191561.981931:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [1->0]
00000100:00100000:0.0:1776191561.981934:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e2f30b71 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630939264:12345-0@lo:400:kworker/u8:2.0
00010000:02020000:1.0:1776191561.981936:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191561.981941:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2404
00000100:00100000:3.0:1776191561.981941:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000081285d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630938688:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191561.981976:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c904ec5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630939072:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191561.981983:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa41a1c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630939200:12345-0@lo:8:kworker/u8:2.0 Request processed in 193us (389us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191561.981985:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e2f30b71 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630939264:12345-0@lo:400:kworker/u8:2.0 Request processed in 49us (103us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191561.981986:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191561.981987:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000038340710 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630939008:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191561.982001:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4843
00000100:00100000:2.0:1776191561.982001:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004fd8278 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630938816:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191561.982002:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2405
00000100:00100000:3.0:1776191561.982010:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f43f1e37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630938944:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191561.982055:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191561.982062:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191561.982066:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191561.982071:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c4e82865 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630939136:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191561.982075:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000250a4bd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630939328:0@lo:400:kworker/u8:2.0
00000100:00080000:1.0:1776191561.982090:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1776191561.982090:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630938944
00000100:00080000:1.0:1776191561.982095:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191561.982100:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048d62137 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630939200:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191561.982104:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191561.982128:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba9731d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630939264:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191561.982140:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630939328
00000100:00100000:3.0:1776191561.982158:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630938688
00000100:00100000:3.0:1776191561.982186:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1662
00000100:00100000:3.0:1776191561.982191:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d2db40d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630938688:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191561.982202:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191561.982234:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4844
00000100:00100000:3.0:1776191561.982238:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d2db40d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630938688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (255us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191561.982243:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b341218 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630938944:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191561.982248:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1662
00000100:00100000:2.0:1776191561.982283:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b341218 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630938944:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (226us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191561.982284:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000081285d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630938688:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191561.982296:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f43f1e37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630938944:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191561.982337:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4844
00000100:00100000:1.0:1776191561.982919:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4845
00000100:00100000:1.0:1776191561.982924:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000eb05ee3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630939328:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191561.982975:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000eb05ee3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630939328:12345-0@lo:400:kworker/u8:2.0 Request processed in 50us (875us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191561.982982:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4845
00000100:00100000:3.0:1776191561.983838:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000250a4bd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630939328:0@lo:400:kworker/u8:2.0
00010000:00010000:3.0:1776191562.746969:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191563.611283:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191563.611340:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191563.611376:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191563.611415:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191563.611456:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613808064
00000100:00100000:3.0:1776191563.611457:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613808000
00000100:00100000:1.0:1776191563.611503:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613808128
00000100:00100000:3.0:1776191563.611509:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1813
00000100:00100000:3.0:1776191563.611517:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ac96f048 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613808000:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191563.611525:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4846
00000100:00100000:1.0:1776191563.611531:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048d62137 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613808064:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191563.611586:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ac96f048 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613808000:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 69us (209us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191563.611593:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1813
00000100:00100000:2.0:1776191563.611618:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613808192
00000100:00100000:2.0:1776191563.611655:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2091
00000100:00100000:2.0:1776191563.611659:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4e82865 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613808192:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191563.611740:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4847
00000100:00100000:0.0:1776191563.611745:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000057cf3599 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613808128:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191563.615250:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4e82865 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613808192:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 3587us (3908us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191563.615268:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2091
00000100:00100000:3.0:1776191563.615757:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191563.616138:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048d62137 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613808064:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 3672us (3929us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191563.616150:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4846
00000100:00100000:2.0:1776191563.616491:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613808256
00000100:00100000:2.0:1776191563.616524:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2406
00000100:00100000:2.0:1776191563.616530:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b6af7b47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613808256:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:2.0:1776191563.616638:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191563.616706:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b6af7b47 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613808256:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 175us (950us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191563.616714:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2406
00000100:00100000:0.0:1776191563.617699:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000057cf3599 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613808128:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 5949us (6280us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191563.617710:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4847
00010000:00010000:3.0:1776191563.773264:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191564.794436:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191565.051242:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000088f7423f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630939392:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191565.051965:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191565.052842:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630939392
00000100:00100000:3.0:1776191565.052895:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3297
00000100:00100000:3.0:1776191565.052901:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000020784d50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630939392:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191565.052934:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191565.052994:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000020784d50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630939392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (1031us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191565.053001:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3297
00000100:00100000:2.0:1776191565.053133:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000088f7423f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630939392:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191565.820561:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191566.076378:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb97b35c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630939456:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191566.076456:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191566.076816:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630939456
00000100:00100000:3.0:1776191566.076870:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3298
00000100:00100000:3.0:1776191566.076876:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c3a79bd4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630939456:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191566.076910:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191566.076958:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c3a79bd4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630939456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (502us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191566.076965:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3298
00000100:00100000:1.0:1776191566.077220:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb97b35c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630939456:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191566.842278:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191567.098301:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb97b35c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630939520:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191567.098373:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191567.098399:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000088f7423f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630939584:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191567.098430:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191567.098450:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000954c89ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630939840:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191567.098470:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191567.098480:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630939584
00000100:00100000:3.0:1776191567.098484:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191567.098488:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008831914d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630939648:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191567.098520:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191567.098521:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1814
00000100:00100000:0.0:1776191567.098527:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b37044fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630939584:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191567.098543:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630939520
00000100:00100000:3.0:1776191567.098568:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1663
00000100:00100000:0.0:1776191567.098571:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b37044fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630939584:12345-0@lo:400:kworker/u8:4.0 Request processed in 45us (142us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191567.098572:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f43f1e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630939520:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191567.098578:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1814
00002000:00000024:3.0:1776191567.098594:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191567.098614:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630939648
00000100:00100000:3.0:1776191567.098620:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f43f1e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630939520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (248us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191567.098626:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1663
00000100:00100000:0.0:1776191567.098639:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4848
00000100:00100000:0.0:1776191567.098642:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f7c3b55d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630939648:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191567.098670:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f7c3b55d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630939648:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (150us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191567.098676:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4848
00000100:00100000:0.0:1776191567.098697:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630939840
00000100:00100000:0.0:1776191567.098720:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3299
00000100:00100000:0.0:1776191567.098723:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004fd8278 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630939840:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191567.098750:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004fd8278 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630939840:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (280us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191567.098755:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3299
00000100:00100000:0.0:1776191567.098789:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008831914d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630939648:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191567.098799:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000954c89ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630939840:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191567.098810:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb97b35c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630939520:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191567.098817:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000088f7423f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630939584:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191567.098835:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776191567.098840:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000019e5e056 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630939904:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191567.098862:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191567.098881:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630939904
00000100:00100000:0.0:1776191567.098901:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1664
00000100:00100000:0.0:1776191567.098905:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090a9e988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630939904:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191567.098914:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191567.098940:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090a9e988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630939904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (78us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191567.098945:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1664
00000100:00100000:0.0:1776191567.098966:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f210a7b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630939712:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191567.098988:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191567.099005:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191567.099009:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fce6fdea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630939776:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191567.099029:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191567.099068:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630939712
00000100:00100000:0.0:1776191567.099087:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3300
00000100:00100000:0.0:1776191567.099090:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000020539371 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630939712:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191567.099121:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000020539371 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630939712:12345-0@lo:400:kworker/u8:4.0 Request processed in 29us (132us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191567.099126:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3300
00000100:00100000:0.0:1776191567.099142:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630939776
00000100:00100000:0.0:1776191567.099162:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4849
00000100:00100000:0.0:1776191567.099165:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7d5fc38 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630939776:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191567.099191:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7d5fc38 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630939776:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (161us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191567.099196:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4849
00000100:00100000:0.0:1776191567.099223:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000019e5e056 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630939904:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191567.099258:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fce6fdea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630939776:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191567.099613:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f210a7b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630939712:0@lo:400:kworker/u8:4.0
00000100:00080000:2.0:1776191567.099791:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191567.099797:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191567.099800:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191567.099804:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4100
00000100:00080000:2.0:1776191567.099807:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191567.099810:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191567.099834:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000bc840106 x1862467630939968/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191567.099857:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191567.099860:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191567.099861:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191567.099864:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4100
00000100:00080000:2.0:1776191567.099865:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191567.099868:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191567.099877:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000603b89b8 x1862467630940032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191567.099918:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000068cadb2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630940096:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191567.099948:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191567.099967:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1776191567.099972:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f210a7b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630940160:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191567.099992:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191567.100066:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc840106 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630939968:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191567.100094:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191567.100116:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000603b89b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630940032:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191567.100146:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191567.100538:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630939968
00000100:00100000:2.0:1776191567.100574:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630940032
00000100:00100000:2.0:1776191567.100635:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2407
00000100:00100000:2.0:1776191567.100640:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000259772a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630939968:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191567.100731:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191567.100768:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000259772a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630939968:12345-0@lo:8:kworker/u8:4.0 Request processed in 127us (673us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191567.100774:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2407
00000100:00100000:2.0:1776191567.100786:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2408
00000100:00100000:2.0:1776191567.100789:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000640b7818 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630940032:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191567.100870:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191567.100896:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000640b7818 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630940032:12345-0@lo:8:kworker/u8:4.0 Request processed in 105us (750us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191567.100901:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2408
00000100:00100000:1.0:1776191567.100992:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630940096
00000100:00100000:1.0:1776191567.101024:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630940160
00000100:00100000:1.0:1776191567.101063:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4850
00000100:00100000:1.0:1776191567.101067:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fce6fdea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630940096:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191567.101113:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fce6fdea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630940096:12345-0@lo:400:kworker/u8:4.0 Request processed in 45us (1164us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191567.101119:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4850
00000100:00100000:1.0:1776191567.101133:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4851
00000100:00100000:1.0:1776191567.101136:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000088f7423f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630940160:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191567.101172:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000088f7423f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630940160:12345-0@lo:400:kworker/u8:4.0 Request processed in 35us (1180us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191567.101178:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4851
00000100:00080000:0.0:1776191567.105509:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191567.105519:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191567.105526:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc840106 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630939968:0@lo:8:kworker/u8:4.0
00000100:00080000:0.0:1776191567.105540:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191567.105542:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191567.105545:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000603b89b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630940032:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191567.105830:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f210a7b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630940160:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191567.105843:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000068cadb2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630940096:0@lo:400:kworker/u8:4.0
00010000:00010000:0.0:1776191567.866407:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191568.735581:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191568.735632:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191568.735687:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191568.735689:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613808576
00000100:00100000:3.0:1776191568.735735:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191568.735807:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613808320
00000100:00100000:2.0:1776191568.735840:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1815
00000100:00100000:2.0:1776191568.735847:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004e50600 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613808320:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191568.735916:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004e50600 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613808320:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 69us (284us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191568.735924:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1815
00000100:00100000:3.0:1776191568.736123:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191568.736150:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613808512
00000100:00100000:3.0:1776191568.736178:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2092
00000100:00100000:3.0:1776191568.736182:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005112615a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613808512:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191568.736227:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005112615a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613808512:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 44us (105us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191568.736234:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2092
00000100:00100000:3.0:1776191568.736248:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2409
00000100:00100000:3.0:1776191568.736251:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019e5e056 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613808576:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:3.0:1776191568.736353:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191568.736386:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019e5e056 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613808576:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 128us (809us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191568.736392:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2409
00000100:00100000:1.0:1776191568.737605:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613808448
00000100:00100000:2.0:1776191568.737605:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613808384
00000100:00100000:2.0:1776191568.739016:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4852
00000100:00100000:2.0:1776191568.739026:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008c618d84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613808384:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191568.739142:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008c618d84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613808384:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 117us (3410us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191568.739150:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4852
00000100:00100000:2.0:1776191568.739428:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4853
00000100:00100000:2.0:1776191568.739433:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4fb1a2d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613808448:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191568.739475:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4fb1a2d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613808448:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 40us (3789us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191568.739482:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4853
00010000:00010000:3.0:1776191568.895343:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191569.930378:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191570.174027:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000068cadb2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630940224:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191570.174144:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191570.174519:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630940224
00000100:00100000:2.0:1776191570.174577:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3301
00000100:00100000:2.0:1776191570.174582:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000078deb88d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630940224:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191570.174617:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191570.174760:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000078deb88d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630940224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 177us (616us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191570.174768:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3301
00000100:00100000:3.0:1776191570.176587:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000068cadb2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630940224:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191570.938248:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191571.194508:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776191571.194531:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004a57869 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630940288:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191571.194600:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191571.194834:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630940288
00000100:00100000:1.0:1776191571.194896:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3302
00000100:00100000:1.0:1776191571.194902:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ec90674 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630940288:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191571.194934:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191571.194978:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ec90674 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630940288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (380us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191571.194984:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3302
00000100:00100000:0.0:1776191571.195093:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004a57869 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630940288:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191571.962252:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191572.218426:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000001c99791 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630940352:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191572.218502:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191572.218561:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630940352
00000100:00100000:2.0:1776191572.218599:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1665
00000100:00100000:2.0:1776191572.218605:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f210a7b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630940352:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191572.218633:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191572.218674:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f210a7b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630940352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (172us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191572.218681:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1665
00000100:00100000:2.0:1776191572.218727:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000001c99791 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630940352:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191572.218748:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1776191572.218757:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000690142e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630940416:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191572.218778:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1776191572.218901:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191572.218906:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191572.218909:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191572.218914:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4105
00000100:00080000:3.0:1776191572.218916:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191572.218920:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191572.218938:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000001c99791 x1862467630940800/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191572.218950:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630940416
00000100:00080000:3.0:1776191572.218952:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191572.218957:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191572.218958:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191572.218961:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4105
00000100:00080000:3.0:1776191572.218963:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191572.218967:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191572.218979:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1666
00000100:00100000:3.0:1776191572.218982:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000003401e3e7 x1862467630940864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191572.218987:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000954c89ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630940416:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191572.219004:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191572.219030:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023dd469f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630940544:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191572.219061:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000954c89ce pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630940416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (281us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191572.219069:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1666
00000100:00100000:3.0:1776191572.219095:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191572.219124:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005302a7ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630940928:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191572.219154:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191572.219169:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:3.0:1776191572.219174:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d1c8a441 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630940480:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191572.219199:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191572.219223:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009d908df0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630940736:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191572.219245:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191572.219271:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630940480
00000100:00100000:3.0:1776191572.219298:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1816
00000100:00100000:3.0:1776191572.219303:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f9005e31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630940480:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191572.219337:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f9005e31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630940480:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (137us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191572.219343:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1816
00000100:00100000:1.0:1776191572.219358:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630940544
00000100:00100000:3.0:1776191572.219380:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630940736
00000100:00100000:1.0:1776191572.219391:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630940928
00000100:00100000:3.0:1776191572.219409:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3303
00000100:00100000:3.0:1776191572.219415:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b8ca4c1a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630940736:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191572.219422:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4854
00000100:00100000:1.0:1776191572.219428:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000035a1136 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630940544:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191572.219447:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b8ca4c1a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630940736:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (200us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191572.219454:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3303
00000100:00100000:1.0:1776191572.219474:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000035a1136 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630940544:12345-0@lo:400:kworker/u8:2.0 Request processed in 44us (377us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191572.219482:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4854
00000100:00100000:3.0:1776191572.219494:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d1c8a441 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630940480:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191572.219498:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4855
00000100:00100000:1.0:1776191572.219504:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000242c8400 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630940928:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191572.219512:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009d908df0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630940736:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191572.219522:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023dd469f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630940544:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191572.219542:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000242c8400 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630940928:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (387us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191572.219550:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005302a7ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630940928:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191572.219551:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4855
00000100:00100000:0.0:1776191572.219640:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000365abfb8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630940672:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191572.219668:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191572.226926:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:0.0:1776191572.226944:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008a102519 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630940608:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191572.227007:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191572.227044:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ef3b35f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630940992:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191572.227058:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630940672
00000100:00100000:0.0:1776191572.227066:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191572.227098:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630940992
00000100:00100000:0.0:1776191572.227110:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630940608
00000100:00100000:1.0:1776191572.227113:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4856
00000100:00100000:1.0:1776191572.227119:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e2ce3f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630940672:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191572.227165:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3304
00000100:00100000:0.0:1776191572.227170:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af393e55 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630940608:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191572.227191:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e2ce3f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630940672:12345-0@lo:400:kworker/u8:2.0 Request processed in 70us (7521us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191572.227200:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4856
00000100:00100000:0.0:1776191572.227208:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af393e55 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630940608:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (201us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191572.227212:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4857
00000100:00100000:2.0:1776191572.227221:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000950cd033 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630940992:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191572.227259:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008a102519 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630940608:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191572.227269:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000950cd033 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630940992:12345-0@lo:400:kworker/u8:2.0 Request processed in 48us (202us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191572.227274:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ef3b35f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630940992:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191572.227278:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4857
00000100:00100000:1.0:1776191572.227289:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000365abfb8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630940672:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191572.227335:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000001c99791 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630940800:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191572.227436:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191572.227466:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003401e3e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630940864:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191572.227486:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000690142e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630940416:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191572.227494:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191572.227533:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630940800
00000100:00100000:1.0:1776191572.227553:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630940864
00000100:00100000:1.0:1776191572.227569:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2410
00000100:00100000:1.0:1776191572.227575:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005fa5d8be pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630940800:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191572.227579:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2411
00000100:00100000:2.0:1776191572.227585:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f32ad823 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630940864:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:1.0:1776191572.228031:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191572.228270:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005fa5d8be pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630940800:12345-0@lo:8:kworker/u8:2.0 Request processed in 694us (833us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191572.228278:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2410
00000100:00080000:3.0:1776191572.228422:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191572.228427:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191572.228432:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000001c99791 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630940800:0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191572.228863:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191572.229017:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f32ad823 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630940864:12345-0@lo:8:kworker/u8:2.0 Request processed in 1430us (1526us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191572.229025:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2411
00000100:00080000:1.0:1776191572.229500:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191572.229505:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191572.229509:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003401e3e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630940864:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191572.230496:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3304
00010000:00010000:3.0:1776191572.986301:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191573.851142:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191573.851193:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191573.851225:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191573.851255:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191573.851267:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613808768
00000100:00100000:3.0:1776191573.851282:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191573.851371:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613808640
00000100:00100000:1.0:1776191573.851404:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1817
00000100:00100000:1.0:1776191573.851411:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000961e9bab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613808640:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191573.851570:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000961e9bab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613808640:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 158us (437us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191573.851578:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1817
00000100:00100000:1.0:1776191573.852854:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613808832
00000100:00100000:1.0:1776191573.852900:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613808896
00000100:00100000:1.0:1776191573.852919:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2093
00000100:00100000:1.0:1776191573.852924:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000067aab686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613808832:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191573.852973:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000067aab686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613808832:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 49us (1720us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191573.852979:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2093
00000100:00100000:1.0:1776191573.852993:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2412
00000100:00100000:1.0:1776191573.852997:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f7c58b5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613808896:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:1.0:1776191573.853113:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191573.853138:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f7c58b5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613808896:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 140us (1856us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191573.853144:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2412
00000100:00100000:1.0:1776191573.853513:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613808704
00000100:00100000:1.0:1776191573.854372:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4858
00000100:00100000:1.0:1776191573.854381:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005302a7ca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613808768:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191573.854442:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005302a7ca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613808768:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 61us (3249us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191573.854449:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4858
00000100:00100000:1.0:1776191573.854468:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4859
00000100:00100000:1.0:1776191573.854473:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f00cec27 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613808704:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191573.854495:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f00cec27 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613808704:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 22us (3271us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191573.854501:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4859
00010000:00010000:3.0:1776191574.010951:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191575.034350:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191575.293364:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008831914d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630941056:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191575.293436:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191575.293733:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630941056
00000100:00100000:2.0:1776191575.293786:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3305
00000100:00100000:2.0:1776191575.293792:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004da0b0e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630941056:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191575.293824:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191575.293873:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004da0b0e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630941056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (438us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191575.293881:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3305
00000100:00100000:1.0:1776191575.294324:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008831914d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630941056:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191576.064820:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191576.314504:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa41a1c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630941120:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191576.314589:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191576.316603:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630941120
00000100:00100000:1.0:1776191576.316676:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3306
00000100:00100000:1.0:1776191576.316682:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008831914d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630941120:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191576.316720:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191576.316803:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008831914d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630941120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (2214us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191576.316810:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3306
00000100:00100000:2.0:1776191576.316989:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa41a1c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630941120:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191577.082354:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191577.338254:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c4e82865 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630941184:0@lo:400:kworker/u8:2.0
00000100:00080000:1.0:1776191577.338260:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191577.338267:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191577.338270:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191577.338276:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4110
00000100:00080000:1.0:1776191577.338279:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191577.338285:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191577.338306:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000038340710 x1862467630941632/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191577.338323:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191577.338327:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191577.338328:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191577.338333:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4110
00000100:00100000:3.0:1776191577.338336:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191577.338337:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191577.338344:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191577.338357:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000c904ec5f x1862467630941696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191577.338377:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb97b35c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630941440:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191577.338410:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000690142e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630941312:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191577.338411:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191577.338436:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aaba3ebf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630941824:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191577.338447:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191577.338470:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191577.338474:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ba9731d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630941568:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191577.338494:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:3.0:1776191577.338501:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004a57869 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630941376:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191577.338508:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191577.338530:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:3.0:1776191577.338532:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191577.338538:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005fa5d8be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630941248:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191577.338552:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa41a1c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630941760:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191577.338568:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191577.338585:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191577.338590:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000250a4bd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630941504:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191577.338618:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191577.338624:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630941824
00000100:00100000:1.0:1776191577.338652:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000038340710 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630941632:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191577.338670:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630941376
00000100:00100000:1.0:1776191577.338680:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191577.338759:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630941440
00000100:00100000:0.0:1776191577.338781:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630941312
00000100:00100000:0.0:1776191577.338795:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3307
00000100:00100000:0.0:1776191577.338800:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdd224e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630941440:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191577.338827:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630941248
00000100:00100000:3.0:1776191577.338855:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630941760
00000100:00100000:0.0:1776191577.338857:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdd224e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630941440:12345-0@lo:400:kworker/u8:2.0 Request processed in 54us (446us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191577.338869:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3307
00000100:00100000:3.0:1776191577.338872:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4860
00000100:00100000:3.0:1776191577.338877:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e56d17f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630941824:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191577.338890:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3308
00000100:00100000:0.0:1776191577.338896:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000043c46f30 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630941312:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191577.338912:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e56d17f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630941824:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (443us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191577.338920:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4860
00000100:00100000:3.0:1776191577.338936:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4861
00000100:00100000:0.0:1776191577.338940:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000043c46f30 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630941312:12345-0@lo:400:kworker/u8:2.0 Request processed in 42us (493us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191577.338942:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f5f736f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630941376:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191577.338955:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3308
00000100:00100000:3.0:1776191577.338981:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f5f736f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630941376:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (450us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191577.338988:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4861
00000100:00100000:2.0:1776191577.339086:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4862
00000100:00100000:2.0:1776191577.339092:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000034b88fee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630941248:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191577.339124:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000034b88fee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630941248:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (558us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191577.339130:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4862
00000100:00100000:2.0:1776191577.339142:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4863
00000100:00100000:2.0:1776191577.339146:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003401e3e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630941760:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191577.339169:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003401e3e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630941760:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (587us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191577.339174:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4863
00000100:00100000:2.0:1776191577.339217:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004be80615 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630941888:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191577.339242:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191577.339268:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630941888
00000100:00100000:2.0:1776191577.339293:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1667
00000100:00100000:2.0:1776191577.339296:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000068cadb2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630941888:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191577.339319:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191577.339350:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000068cadb2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630941888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (108us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191577.339355:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1667
00000100:00100000:2.0:1776191577.339391:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004be80615 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630941888:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191577.339427:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1776191577.339433:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004be80615 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630941952:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191577.339453:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191577.339471:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630941952
00000100:00100000:2.0:1776191577.339490:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1668
00000100:00100000:2.0:1776191577.339493:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000603b89b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630941952:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191577.339502:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191577.339525:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000603b89b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630941952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 30us (71us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191577.339531:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1668
00000100:00100000:2.0:1776191577.339552:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004be80615 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630941952:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191577.339589:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630941184
00000100:00100000:3.0:1776191577.339845:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004a57869 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630941376:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191577.339858:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa41a1c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630941760:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191577.339869:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aaba3ebf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630941824:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191577.339879:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb97b35c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630941440:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191577.341355:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c904ec5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630941696:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191577.341410:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191577.342985:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630941568
00000100:00100000:0.0:1776191577.343067:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630941504
00000100:00100000:0.0:1776191577.343086:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630941632
00000100:00100000:0.0:1776191577.343095:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630941696
00000100:00100000:0.0:1776191577.343107:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2094
00000100:00100000:0.0:1776191577.343113:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000859dbd41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630941568:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191577.343198:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000859dbd41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630941568:12345-0@lo:400:kworker/u8:2.0 Request processed in 84us (4692us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191577.343205:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2094
00000100:00100000:0.0:1776191577.343223:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2095
00000100:00100000:0.0:1776191577.343227:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000939787e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630941504:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191577.343254:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000939787e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630941504:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (4637us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191577.343260:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2095
00000100:00100000:0.0:1776191577.343271:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2413
00000100:00100000:0.0:1776191577.343275:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a426c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630941632:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191577.343374:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191577.343411:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a426c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630941632:12345-0@lo:8:kworker/u8:2.0 Request processed in 134us (4732us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191577.343421:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2413
00000100:00100000:0.0:1776191577.343432:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2414
00000100:00100000:0.0:1776191577.343435:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a0c5ca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630941696:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191577.343732:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191577.343761:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a0c5ca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630941696:12345-0@lo:8:kworker/u8:2.0 Request processed in 324us (2351us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191577.343768:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2414
00000100:00100000:0.0:1776191577.343817:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005fa5d8be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630941248:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191577.343830:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000250a4bd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630941504:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191577.343840:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000690142e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630941312:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191577.343850:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ba9731d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630941568:0@lo:400:kworker/u8:2.0
00000100:00080000:0.0:1776191577.343888:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191577.343892:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191577.343895:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000038340710 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630941632:0@lo:8:kworker/u8:2.0
00000100:00080000:0.0:1776191577.343904:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191577.343906:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191577.343908:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c904ec5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630941696:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191577.345513:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1818
00000100:00100000:2.0:1776191577.345523:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dce6a0d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630941184:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191577.345613:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dce6a0d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630941184:12345-0@lo:400:kworker/u8:2.0 Request processed in 90us (7281us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191577.345621:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1818
00000100:00100000:0.0:1776191577.345747:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c4e82865 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630941184:0@lo:400:kworker/u8:2.0
00010000:00010000:3.0:1776191578.106243:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191578.971266:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191578.971321:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191578.971363:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191578.971398:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191578.971426:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191578.971461:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613809024
00000100:00100000:3.0:1776191578.971519:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613809088
00000100:00100000:3.0:1776191578.971540:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4864
00000100:00100000:3.0:1776191578.971547:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef3b35f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613809024:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191578.971627:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef3b35f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613809024:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 68us (357us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191578.971636:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4864
00000100:00100000:3.0:1776191578.971653:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4865
00000100:00100000:3.0:1776191578.971657:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c904ec5f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613809088:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191578.971681:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c904ec5f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613809088:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 23us (283us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191578.971687:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4865
00000100:00100000:1.0:1776191578.973108:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613809152
00000100:00100000:1.0:1776191578.973162:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613809216
00000100:00100000:1.0:1776191578.973180:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2096
00000100:00100000:1.0:1776191578.973186:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4e82865 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613809152:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191578.973236:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4e82865 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613809152:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 50us (1916us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191578.973244:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2096
00000100:00100000:1.0:1776191578.973259:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2415
00000100:00100000:1.0:1776191578.973264:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000038340710 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613809216:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:1.0:1776191578.973370:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191578.973395:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000038340710 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613809216:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 131us (1969us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191578.973402:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2415
00000100:00100000:2.0:1776191578.973771:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613808960
00000100:00100000:2.0:1776191578.973800:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1819
00000100:00100000:2.0:1776191578.973805:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd42e839 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613808960:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191578.973837:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd42e839 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613808960:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 31us (2473us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191578.973843:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1819
00010000:00010000:3.0:1776191579.133003:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191580.156809:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191580.410994:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191580.411020:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004be80615 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630942016:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191580.411118:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191580.411642:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630942016
00000100:00100000:2.0:1776191580.411700:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3309
00000100:00100000:2.0:1776191580.411707:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000086a13048 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630942016:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191580.411745:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191580.411813:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000086a13048 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630942016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (696us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191580.411820:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3309
00000100:00100000:1.0:1776191580.412009:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004be80615 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630942016:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191581.179375:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191581.434313:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191581.434329:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008d31571c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630942080:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191581.434403:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191581.434466:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630942080
00000100:00100000:1.0:1776191581.434516:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3310
00000100:00100000:1.0:1776191581.434522:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba9731d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630942080:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191581.434556:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191581.434612:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba9731d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630942080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (210us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191581.434620:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3310
00000100:00100000:3.0:1776191581.434657:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008d31571c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630942080:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191582.203235:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1776191582.458230:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191582.458235:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191582.458238:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191582.458244:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4115
00000100:00080000:1.0:1776191582.458247:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191582.458251:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191582.458268:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000e30dc2ee x1862467630942592/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191582.458280:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191582.458283:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191582.458284:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191582.458287:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4115
00000100:00080000:1.0:1776191582.458288:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191582.458291:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191582.458302:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000007bb93380 x1862467630942656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191582.458339:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aaba3ebf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630942336:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191582.458401:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191582.458427:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000552b8f18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630942720:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191582.458450:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191582.458468:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:1.0:1776191582.458473:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008d31571c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630942272:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191582.458496:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191582.458511:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001648d249 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630942528:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191582.458543:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191582.458575:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630942272
00000100:00100000:1.0:1776191582.458612:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3311
00000100:00100000:1.0:1776191582.458630:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019dcd236 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630942272:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191582.458683:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019dcd236 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630942272:12345-0@lo:400:kworker/u8:4.0 Request processed in 62us (186us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191582.458690:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3311
00000100:00100000:1.0:1776191582.458739:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008d31571c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630942272:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191582.458752:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191582.458757:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004be80615 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630942912:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191582.458781:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191582.458814:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d60a5454 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630942144:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191582.458821:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e30dc2ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630942592:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191582.458859:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191582.458861:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191582.458884:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008d1e8454 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630942400:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191582.458888:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007bb93380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630942656:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191582.458928:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191582.458936:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191582.458947:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000016f04c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630942784:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191582.458970:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630942400
00000100:00100000:1.0:1776191582.458993:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3312
00000100:00100000:1.0:1776191582.458997:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e72cee95 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630942400:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191582.459052:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e72cee95 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630942400:12345-0@lo:400:kworker/u8:4.0 Request processed in 33us (117us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191582.459060:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3312
00000100:00100000:1.0:1776191582.459090:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630942528
00000100:00100000:1.0:1776191582.459113:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630942592
00000100:00100000:1.0:1776191582.459127:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630942656
00000100:00100000:1.0:1776191582.459140:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2097
00000100:00100000:1.0:1776191582.459143:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004905ea34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630942528:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191582.459178:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004905ea34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630942528:12345-0@lo:400:kworker/u8:4.0 Request processed in 33us (634us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191582.459185:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2097
00000100:00100000:0.0:1776191582.459193:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191582.459202:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2416
00000100:00100000:1.0:1776191582.459207:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d71ef7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630942592:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191582.459225:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008d1e8454 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630942400:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191582.459237:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [3->2]
00000100:00100000:0.0:1776191582.459242:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630942208:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191582.459261:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191582.459273:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000911fdeb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630942464:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191582.459290:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191582.459297:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc840106 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630942848:0@lo:13:osp-pre-0-1.0
00010000:02020000:1.0:1776191582.459306:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191582.459315:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191582.459346:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630942464
00000100:00100000:1.0:1776191582.459351:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d71ef7e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630942592:12345-0@lo:8:kworker/u8:4.0 Request processed in 142us (493us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191582.459358:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2416
00000100:00100000:0.0:1776191582.459373:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2098
00000100:00100000:0.0:1776191582.459378:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007756d7ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630942464:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191582.459425:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630942912
00000100:00100000:3.0:1776191582.459448:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630942336
00000100:00100000:2.0:1776191582.459472:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630942848
00000100:00100000:3.0:1776191582.459485:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630942720
00000100:00100000:2.0:1776191582.459498:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1669
00000100:00100000:2.0:1776191582.459503:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b044802b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630942912:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191582.459511:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630942784
00002000:00000024:2.0:1776191582.459524:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191582.459531:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630942208
00000100:00100000:3.0:1776191582.459546:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4866
00000100:00100000:3.0:1776191582.459550:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000023bc758a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630942336:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191582.459562:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b044802b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630942912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (779us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191582.459569:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1669
00000100:00100000:2.0:1776191582.459585:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1670
00000100:00100000:2.0:1776191582.459589:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016dc0009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630942848:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191582.459592:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000023bc758a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630942336:12345-0@lo:400:kworker/u8:4.0 Request processed in 39us (1191us total) trans 0 rc 0/0
00002000:00000024:2.0:1776191582.459602:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191582.459605:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4866
00000100:00100000:3.0:1776191582.459622:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4867
00000100:00100000:3.0:1776191582.459625:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004d13a9eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630942720:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191582.459652:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016dc0009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630942848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (336us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191582.459663:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1670
00000100:00100000:3.0:1776191582.459663:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004d13a9eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630942720:12345-0@lo:400:kworker/u8:4.0 Request processed in 33us (1209us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191582.459673:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4867
00000100:00100000:3.0:1776191582.459688:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4868
00000100:00100000:3.0:1776191582.459692:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000263400d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630942784:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191582.459701:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4869
00000100:00100000:2.0:1776191582.459707:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e486c123 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630942208:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191582.459718:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000263400d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630942784:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (526us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191582.459724:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4868
00000100:00100000:2.0:1776191582.459745:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e486c123 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630942208:12345-0@lo:400:kworker/u8:4.0 Request processed in 36us (481us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191582.459751:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4869
00000100:00100000:0.0:1776191582.459822:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007756d7ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630942464:12345-0@lo:400:kworker/u8:4.0 Request processed in 443us (531us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191582.460249:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630942144
00000100:00100000:2.0:1776191582.460278:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1820
00000100:00100000:2.0:1776191582.460282:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002224990e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630942144:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191582.460316:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002224990e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630942144:12345-0@lo:400:kworker/u8:4.0 Request processed in 32us (1460us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191582.460322:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1820
00000100:00080000:2.0:1776191582.460364:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191582.460368:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191582.460372:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e30dc2ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630942592:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191582.460401:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004be80615 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630942912:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191582.460410:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001648d249 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630942528:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191582.460419:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aaba3ebf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630942336:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191582.460428:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000552b8f18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630942720:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191582.460552:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2417
00000100:00100000:1.0:1776191582.460557:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000be03407 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630942656:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191582.460644:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191582.460680:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000be03407 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630942656:12345-0@lo:8:kworker/u8:4.0 Request processed in 122us (1746us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191582.460686:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2417
00000100:00080000:1.0:1776191582.460712:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191582.460715:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191582.460718:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007bb93380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630942656:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191582.460770:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630942208:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191582.460781:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000911fdeb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630942464:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191582.460792:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc840106 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630942848:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191582.460799:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d60a5454 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630942144:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191582.460807:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000016f04c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630942784:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191582.461251:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2098
00010000:00010000:3.0:1776191583.226333:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191584.101205:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191584.101254:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191584.101288:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191584.101309:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191584.101332:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191584.101415:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613809536
00000100:00100000:3.0:1776191584.101464:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613809472
00000100:00100000:3.0:1776191584.101495:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2099
00000100:00100000:3.0:1776191584.101502:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a4d9e8c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613809472:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191584.101572:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a4d9e8c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613809472:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 70us (241us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191584.101580:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2099
00000100:00100000:3.0:1776191584.101598:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2418
00000100:00100000:3.0:1776191584.101602:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a8e91aa5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613809536:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:3.0:1776191584.101704:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191584.101730:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a8e91aa5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613809536:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 127us (421us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191584.101737:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2418
00000100:00100000:3.0:1776191584.101853:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613809280
00000100:00100000:3.0:1776191584.101876:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1821
00000100:00100000:3.0:1776191584.101893:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e89cfd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613809280:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191584.101922:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e89cfd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613809280:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 41us (669us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191584.101978:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1821
00000100:00100000:2.0:1776191584.102361:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613809344
00000100:00100000:2.0:1776191584.102404:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613809408
00000100:00100000:2.0:1776191584.102433:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4870
00000100:00100000:2.0:1776191584.102438:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ce69651 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613809344:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191584.102482:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ce69651 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613809344:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 43us (1286us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191584.102489:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4870
00000100:00100000:2.0:1776191584.102504:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4871
00000100:00100000:2.0:1776191584.102508:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096ba125a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613809408:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191584.102531:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096ba125a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613809408:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 22us (1243us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191584.102537:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4871
00010000:00010000:3.0:1776191584.251597:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191585.274241:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191585.530500:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191585.530517:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004be80615 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630942976:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191585.530583:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191585.530689:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630942976
00000100:00100000:0.0:1776191585.530744:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3313
00000100:00100000:0.0:1776191585.530749:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000690142e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630942976:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191585.530780:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191585.530832:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000690142e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630942976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (249us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191585.530839:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3313
00000100:00100000:3.0:1776191585.530941:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004be80615 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630942976:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191586.298345:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191586.554811:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000af122859 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630943040:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191586.554892:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191586.555059:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630943040
00000100:00100000:1.0:1776191586.555674:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3314
00000100:00100000:1.0:1776191586.555682:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e555734e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630943040:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191586.555920:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191586.555987:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e555734e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630943040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 304us (1095us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191586.555994:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3314
00000100:00100000:0.0:1776191586.556644:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000af122859 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630943040:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191587.322372:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1776191587.579229:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191587.579236:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191587.579239:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191587.579246:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4120
00000100:00080000:1.0:1776191587.579249:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191587.579255:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191587.579273:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000009ff26b50 x1862467630943552/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191587.579287:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191587.579290:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191587.579292:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191587.579294:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4120
00000100:00080000:1.0:1776191587.579296:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191587.579299:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191587.579307:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000009af94ad9 x1862467630943616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191587.579336:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d60a5454 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630943168:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191587.579396:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191587.579426:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000caebeb11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630943424:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191587.579449:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191587.579465:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:1.0:1776191587.579470:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630943232:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191587.579493:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191587.579504:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d9f622e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630943488:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191587.579521:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191587.579544:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ff26b50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630943552:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191587.579565:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191587.579579:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009af94ad9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630943616:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191587.579597:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191587.579626:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630943168
00000100:00100000:1.0:1776191587.579664:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4872
00000100:00100000:1.0:1776191587.579670:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a2b80b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630943168:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191587.579716:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a2b80b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630943168:12345-0@lo:400:kworker/u8:4.0 Request processed in 45us (321us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191587.579725:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4872
00000100:00100000:1.0:1776191587.579750:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630943424
00000100:00100000:1.0:1776191587.579771:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630943488
00000100:00100000:1.0:1776191587.579783:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630943552
00000100:00100000:0.0:1776191587.579912:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630943616
00000100:00100000:0.0:1776191587.579929:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2100
00000100:00100000:0.0:1776191587.579933:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d0e4254d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630943424:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191587.579969:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d0e4254d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630943424:12345-0@lo:400:kworker/u8:4.0 Request processed in 34us (519us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191587.579974:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2100
00000100:00100000:0.0:1776191587.579985:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2101
00000100:00100000:0.0:1776191587.579988:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3653833 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630943488:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191587.580012:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3653833 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630943488:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (491us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191587.580018:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2101
00000100:00100000:0.0:1776191587.580029:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2419
00000100:00100000:0.0:1776191587.580052:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a0f2d502 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630943616:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191587.580164:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191587.580196:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a0f2d502 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630943616:12345-0@lo:8:kworker/u8:4.0 Request processed in 163us (599us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191587.580203:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2419
00000100:00100000:0.0:1776191587.580221:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000af122859 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630943104:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191587.580249:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191587.580261:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008d31571c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630943360:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191587.580278:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191587.580291:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fb519ed0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630943744:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191587.580309:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191587.580322:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:0.0:1776191587.580327:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aaba3ebf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630943296:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191587.580345:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191587.580355:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004250bccf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630943680:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191587.580371:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191587.580394:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630943232
00000100:00100000:0.0:1776191587.580409:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630943360
00000100:00100000:0.0:1776191587.580420:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3315
00000100:00100000:0.0:1776191587.580424:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e600ea8b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630943232:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191587.580453:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e600ea8b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630943232:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (960us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191587.580459:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3315
00000100:00100000:0.0:1776191587.580470:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3316
00000100:00100000:0.0:1776191587.580473:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000640b7818 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630943360:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191587.580501:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000640b7818 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630943360:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (222us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191587.580506:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3316
00000100:00080000:0.0:1776191587.580538:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191587.580542:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191587.580545:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009af94ad9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630943616:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191587.580567:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630943744
00000100:00100000:0.0:1776191587.580585:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630943296
00000100:00100000:0.0:1776191587.580597:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630943680
00000100:00100000:0.0:1776191587.580610:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4873
00000100:00100000:0.0:1776191587.580614:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000911fdeb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630943744:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191587.580642:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000911fdeb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630943744:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (333us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191587.580647:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4873
00000100:00100000:0.0:1776191587.580657:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4874
00000100:00100000:0.0:1776191587.580660:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d1e8454 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630943296:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191587.580680:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d1e8454 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630943296:12345-0@lo:400:kworker/u8:4.0 Request processed in 20us (335us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191587.580685:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4874
00000100:00100000:0.0:1776191587.580697:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4875
00000100:00100000:0.0:1776191587.580700:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb1d57ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630943680:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191587.580722:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb1d57ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630943680:12345-0@lo:400:kworker/u8:4.0 Request processed in 21us (351us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191587.580727:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4875
00000100:00100000:0.0:1776191587.580750:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aaba3ebf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630943296:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191587.580757:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004250bccf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630943680:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191587.580764:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008d31571c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630943360:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191587.580770:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fb519ed0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630943744:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191587.581327:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630943232:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191587.581338:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d9f622e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630943488:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191587.581347:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d60a5454 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630943168:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191587.581355:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000caebeb11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630943424:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191587.581475:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2420
00000100:00100000:1.0:1776191587.581479:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0aeb4f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630943552:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191587.581565:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191587.581607:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0aeb4f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630943552:12345-0@lo:8:kworker/u8:4.0 Request processed in 127us (2040us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191587.581612:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2420
00000100:00080000:1.0:1776191587.581634:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191587.581637:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191587.581639:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ff26b50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630943552:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191587.582018:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630943104
00000100:00100000:2.0:1776191587.582058:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1822
00000100:00100000:2.0:1776191587.582063:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f3625dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630943104:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191587.582103:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f3625dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630943104:12345-0@lo:400:kworker/u8:4.0 Request processed in 39us (1853us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191587.582109:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1822
00000100:00100000:2.0:1776191587.582148:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000af122859 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630943104:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191587.582205:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191587.582216:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004be80615 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630943808:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191587.582245:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191587.582308:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630943808
00000100:00100000:2.0:1776191587.582365:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1671
00000100:00100000:2.0:1776191587.582368:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000250a4bd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630943808:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191587.582388:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191587.582419:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000250a4bd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630943808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (173us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191587.582425:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1671
00000100:00100000:1.0:1776191587.584893:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191587.584925:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000994ca5e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630943872:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191587.584995:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191587.587476:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630943872
00000100:00100000:3.0:1776191587.587603:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1672
00000100:00100000:3.0:1776191587.587612:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000011caeb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630943872:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191587.587641:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191587.587718:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000011caeb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630943872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (2723us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191587.587725:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1672
00000100:00100000:1.0:1776191587.587828:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000994ca5e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630943872:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191587.588065:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004be80615 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630943808:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1776191588.346389:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191589.211684:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191589.211799:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191589.211837:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191589.211867:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191589.211889:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191589.211955:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613809600
00000100:00100000:2.0:1776191589.212004:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1823
00000100:00100000:2.0:1776191589.212011:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e270043d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613809600:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191589.212118:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e270043d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613809600:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 106us (319us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191589.212126:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1823
00000100:00100000:2.0:1776191589.212278:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613809728
00000100:00100000:2.0:1776191589.212305:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613809664
00000100:00100000:2.0:1776191589.212324:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4876
00000100:00100000:2.0:1776191589.212328:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b9f58501 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613809728:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191589.212365:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b9f58501 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613809728:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 36us (529us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191589.212372:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4876
00000100:00100000:2.0:1776191589.212384:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4877
00000100:00100000:2.0:1776191589.212388:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000551a670c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613809664:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191589.212409:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000551a670c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613809664:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 21us (543us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191589.212415:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4877
00000100:00100000:1.0:1776191589.213482:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613809856
00000100:00100000:1.0:1776191589.213639:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613809792
00000100:00100000:2.0:1776191589.213687:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2102
00000100:00100000:2.0:1776191589.213694:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000481c290f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613809792:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191589.213759:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000481c290f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613809792:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 64us (1869us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191589.213766:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2102
00000100:00100000:2.0:1776191589.213794:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2421
00000100:00100000:2.0:1776191589.213798:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000011eb3cbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613809856:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:2.0:1776191589.213896:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191589.213922:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000011eb3cbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613809856:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 123us (2247us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191589.213929:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2421
00010000:00010000:3.0:1776191589.371904:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191590.394363:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191590.650299:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191590.650322:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005fa5d8be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630943936:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191590.650390:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191590.650487:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630943936
00000100:00100000:3.0:1776191590.650538:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3317
00000100:00100000:3.0:1776191590.650544:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003f01d2f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630943936:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191590.650579:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191590.650622:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003f01d2f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630943936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (233us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191590.650630:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3317
00000100:00100000:0.0:1776191590.650714:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005fa5d8be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630943936:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191591.418360:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191591.674486:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000061ace3cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630944000:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191591.674553:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191591.674807:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630944000
00000100:00100000:1.0:1776191591.674904:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3318
00000100:00100000:1.0:1776191591.674911:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000994ca5e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630944000:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191591.674941:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191591.675001:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000994ca5e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630944000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (449us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191591.675008:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3318
00000100:00100000:0.0:1776191591.675347:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000061ace3cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630944000:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191592.442680:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191592.698551:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191592.698573:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc840106 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630944064:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191592.698653:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191592.698915:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630944064
00000100:00100000:2.0:1776191592.698967:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1673
00000100:00100000:2.0:1776191592.698973:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb97b35c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630944064:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191592.699013:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191592.699085:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb97b35c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630944064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (433us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191592.699093:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1673
00000100:00100000:0.0:1776191592.699181:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc840106 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630944064:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1776191592.699585:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1776191592.699589:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004a57869 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630944256:0@lo:400:kworker/u8:4.0
00000100:00080000:3.0:1776191592.699590:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191592.699593:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191592.699596:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4125
00000100:00080000:3.0:1776191592.699598:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191592.699602:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191592.699623:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191592.699636:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000029599f7c x1862467630944576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191592.699642:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ed05c09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630944512:0@lo:400:kworker/u8:4.0
00000100:00080000:3.0:1776191592.699649:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191592.699652:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191592.699654:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191592.699656:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4125
00000100:00080000:3.0:1776191592.699658:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191592.699661:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191592.699663:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191592.699670:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000001105f678 x1862467630944640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191592.699678:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:0.0:1776191592.699682:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa41a1c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630944192:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191592.699715:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191592.699726:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630944512
00000100:00100000:0.0:1776191592.699728:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a11d504 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630944448:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191592.699748:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191592.699752:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2103
00000100:00100000:3.0:1776191592.699756:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a6d843e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630944512:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191592.699773:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630944192
00000100:00100000:3.0:1776191592.699792:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a6d843e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630944512:12345-0@lo:400:kworker/u8:4.0 Request processed in 35us (128us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191592.699799:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2103
00000100:00100000:0.0:1776191592.699812:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1824
00000100:00100000:0.0:1776191592.699816:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fecbd6f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630944192:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191592.699818:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630944256
00000100:00100000:3.0:1776191592.699839:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4878
00000100:00100000:3.0:1776191592.699842:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d60a5454 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630944256:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191592.699843:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fecbd6f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630944192:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (129us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191592.699849:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1824
00000100:00100000:3.0:1776191592.699867:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d60a5454 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630944256:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (244us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191592.699872:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4878
00000100:00100000:3.0:1776191592.699900:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc840106 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630944128:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191592.699923:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191592.699936:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be32aae2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630944384:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191592.699968:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191592.699980:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2477cb3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630944768:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191592.700003:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630944448
00000100:00100000:0.0:1776191592.700030:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3319
00000100:00100000:0.0:1776191592.700066:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d31571c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630944448:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191592.700096:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d31571c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630944448:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (348us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191592.700102:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3319
00000100:00100000:0.0:1776191592.700144:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa41a1c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630944192:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191592.700152:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a11d504 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630944448:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191592.700160:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004a57869 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630944256:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191592.700168:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ed05c09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630944512:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191592.700493:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630944128
00000100:00100000:0.0:1776191592.700518:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1674
00000100:00100000:0.0:1776191592.700521:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af44226e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630944128:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191592.700533:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191592.700560:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af44226e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630944128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (637us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191592.700566:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1674
00000100:00100000:0.0:1776191592.700591:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630944384
00000100:00100000:0.0:1776191592.700613:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4879
00000100:00100000:0.0:1776191592.700616:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2e3dc1e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630944384:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191592.700642:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2e3dc1e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630944384:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (675us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191592.700648:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4879
00000100:00100000:1.0:1776191592.700808:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029599f7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630944576:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191592.700839:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191592.700842:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191592.700861:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001105f678 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630944640:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191592.700875:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc840106 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630944128:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191592.700885:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be32aae2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630944384:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191592.700888:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191592.700896:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:3.0:1776191592.700901:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005fa5d8be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630944320:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191592.700915:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630944576
00000100:00100000:3.0:1776191592.700921:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191592.700931:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630944640
00000100:00100000:3.0:1776191592.700935:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000049908ee0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630944704:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191592.700943:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2422
00000100:00100000:1.0:1776191592.700947:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c2466414 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630944576:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191592.700952:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191592.700968:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630944320
00000100:00100000:3.0:1776191592.700987:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3320
00000100:00100000:3.0:1776191592.700990:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9a725e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630944320:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191592.701030:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9a725e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630944320:12345-0@lo:400:kworker/u8:4.0 Request processed in 39us (108us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191592.701050:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3320
00010000:02020000:1.0:1776191592.701055:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191592.701065:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630944768
00000100:00100000:3.0:1776191592.701081:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630944704
00000100:00100000:1.0:1776191592.701083:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c2466414 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630944576:12345-0@lo:8:kworker/u8:4.0 Request processed in 136us (245us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191592.701089:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2422
00000100:00100000:1.0:1776191592.701099:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2423
00000100:00100000:1.0:1776191592.701102:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a0236b56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630944640:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191592.701105:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4880
00000100:00100000:3.0:1776191592.701108:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009e7f18ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630944768:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191592.701135:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009e7f18ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630944768:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (1135us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191592.701141:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4880
00000100:00100000:3.0:1776191592.701155:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4881
00000100:00100000:3.0:1776191592.701168:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef1632e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630944704:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191592.701190:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef1632e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630944704:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (237us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191592.701196:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4881
00010000:02020000:1.0:1776191592.701202:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191592.701219:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005fa5d8be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630944320:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191592.701223:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a0236b56 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630944640:12345-0@lo:8:kworker/u8:4.0 Request processed in 120us (335us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191592.701228:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000049908ee0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630944704:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191592.701229:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2423
00000100:00100000:3.0:1776191592.701235:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2477cb3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630944768:0@lo:400:kworker/u8:4.0
00000100:00080000:1.0:1776191592.701248:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191592.701251:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191592.701254:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029599f7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630944576:0@lo:8:kworker/u8:4.0
00000100:00080000:1.0:1776191592.701267:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191592.701270:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191592.701273:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001105f678 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630944640:0@lo:8:kworker/u8:4.0
00010000:00010000:3.0:1776191593.467747:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191594.331452:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191594.333706:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613809920
00000100:00100000:0.0:1776191594.333773:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1825
00000100:00100000:0.0:1776191594.333779:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f7ed2aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613809920:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191594.333856:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f7ed2aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613809920:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 77us (2413us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191594.333864:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1825
00000100:00100000:3.0:1776191594.335500:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191594.335698:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613809984
00000100:00100000:1.0:1776191594.335753:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4882
00000100:00100000:1.0:1776191594.335758:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bce8a16d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613809984:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191594.335811:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bce8a16d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613809984:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 52us (318us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191594.335817:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4882
00000100:00100000:3.0:1776191594.337798:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191594.337883:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191594.337989:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191594.338073:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613810048
00000100:00100000:2.0:1776191594.338140:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4883
00000100:00100000:2.0:1776191594.338146:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029b0687d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613810048:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191594.338218:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029b0687d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613810048:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 71us (230us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191594.338226:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4883
00000100:00100000:0.0:1776191594.339887:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613810112
00000100:00100000:1.0:1776191594.339887:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613810176
00000100:00100000:1.0:1776191594.340264:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2104
00000100:00100000:1.0:1776191594.340272:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008dbfa9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613810112:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191594.340319:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2424
00000100:00100000:0.0:1776191594.340326:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ea373370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613810176:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00000100:00100000:1.0:1776191594.340360:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008dbfa9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613810112:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 88us (2477us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191594.340368:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2104
00010000:02020000:0.0:1776191594.340420:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191594.340682:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ea373370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613810176:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 354us (2889us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191594.340690:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2424
00010000:00010000:3.0:1776191594.490403:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191595.514210:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191595.774777:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085501c10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630944832:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191595.774848:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191595.775308:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630944832
00000100:00100000:0.0:1776191595.775680:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3321
00000100:00100000:0.0:1776191595.775686:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004be80615 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630944832:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191595.775734:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191595.777591:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004be80615 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630944832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1897us (2736us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191595.777591:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085501c10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630944832:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191595.777608:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3321
00010000:00010000:3.0:1776191596.538977:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191596.794304:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1776191596.794318:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002460ac97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630944896:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191596.794678:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191596.794853:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630944896
00000100:00100000:0.0:1776191596.794944:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3322
00000100:00100000:0.0:1776191596.794951:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000012ee9fc3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630944896:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191596.794985:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191596.795059:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000012ee9fc3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630944896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (383us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191596.795066:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3322
00000100:00100000:2.0:1776191596.795273:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002460ac97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630944896:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191597.563151:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191597.818270:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191597.818291:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030c9704c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630944960:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191597.818363:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191597.818401:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc840106 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630945024:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191597.818426:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191597.818427:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630944960
00000100:00100000:2.0:1776191597.818471:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630945024
00000100:00100000:3.0:1776191597.818483:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1675
00000100:00100000:3.0:1776191597.818490:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009916a1d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630944960:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191597.818715:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1676
00000100:00100000:2.0:1776191597.818722:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d0c84519 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630945024:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191597.818752:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00002000:00000024:3.0:1776191597.818814:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191597.818817:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000061ace3cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630945216:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191597.818858:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191597.818885:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776191597.818892:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e61c6045 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630945280:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191597.818920:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191597.818944:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630945216
00000100:00100000:0.0:1776191597.819062:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3323
00000100:00100000:0.0:1776191597.819067:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aaba3ebf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630945216:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191597.819113:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aaba3ebf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630945216:12345-0@lo:400:kworker/u8:2.0 Request processed in 45us (256us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191597.819120:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3323
00000100:00100000:0.0:1776191597.819157:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000061ace3cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630945216:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191597.819190:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d78e42e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630945088:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191597.819219:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191597.819239:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191597.819243:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002460ac97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630945152:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191597.819263:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191597.819287:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630945280
00000100:00100000:0.0:1776191597.819312:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630945152
00000100:00100000:0.0:1776191597.819331:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4884
00000100:00100000:0.0:1776191597.819335:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be32aae2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630945280:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191597.819367:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be32aae2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630945280:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (447us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191597.819373:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4884
00000100:00100000:0.0:1776191597.819384:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4885
00000100:00100000:0.0:1776191597.819388:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ed05c09 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630945152:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191597.819414:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ed05c09 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630945152:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (150us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191597.819420:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4885
00000100:00100000:0.0:1776191597.819450:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e61c6045 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630945280:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191597.819472:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002460ac97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630945152:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191597.819680:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d0c84519 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630945024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 956us (1252us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191597.819687:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1676
00000100:00100000:2.0:1776191597.819709:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630945088
00000100:00100000:2.0:1776191597.819735:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1826
00000100:00100000:2.0:1776191597.819739:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000328cc67f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630945088:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191597.819773:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000328cc67f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630945088:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (555us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191597.819779:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1826
00000100:00100000:0.0:1776191597.820364:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc840106 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630945024:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191597.821725:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d78e42e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630945088:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191597.822644:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009916a1d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630944960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3937us (4066us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191597.822652:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030c9704c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630944960:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191597.822662:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1675
00000100:00100000:1.0:1776191597.822974:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a11d504 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630945344:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191597.823049:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1776191597.823119:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1776191597.823123:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630945344
00000100:00080000:0.0:1776191597.823125:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191597.823129:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191597.823134:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4130
00000100:00080000:0.0:1776191597.823137:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191597.823141:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191597.823172:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000003d78e42e x1862467630945408/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191597.823178:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3324
00000100:00100000:3.0:1776191597.823189:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ecc8f95b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630945344:12345-0@lo:400:kworker/u8:2.0
00000100:00080000:0.0:1776191597.823208:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191597.823211:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191597.823213:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191597.823217:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4130
00000100:00080000:0.0:1776191597.823219:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191597.823222:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191597.823236:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000002460ac97 x1862467630945472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191597.827640:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000061ace3cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630945536:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191597.827640:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ecc8f95b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630945344:12345-0@lo:400:kworker/u8:2.0 Request processed in 4449us (4605us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191597.827712:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191597.827914:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630945536
00000100:00100000:2.0:1776191597.827962:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4886
00000100:00100000:2.0:1776191597.827968:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005fa5d8be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630945536:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191597.828050:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005fa5d8be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630945536:12345-0@lo:400:kworker/u8:2.0 Request processed in 81us (338us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191597.828058:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4886
00000100:00100000:2.0:1776191597.828107:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000061ace3cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630945536:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191597.828149:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003d78e42e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630945408:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191597.828179:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191597.828196:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002460ac97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630945472:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191597.828216:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191597.828244:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630945408
00000100:00100000:2.0:1776191597.828263:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630945472
00000100:00100000:2.0:1776191597.828525:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2425
00000100:00100000:2.0:1776191597.828530:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc840106 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630945408:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191597.828639:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191597.828675:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc840106 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630945408:12345-0@lo:8:kworker/u8:2.0 Request processed in 144us (495us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191597.828682:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2425
00000100:00100000:2.0:1776191597.828694:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2426
00000100:00100000:2.0:1776191597.828697:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000061ace3cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630945472:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191597.828884:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191597.828910:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000061ace3cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630945472:12345-0@lo:8:kworker/u8:2.0 Request processed in 211us (694us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191597.828916:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2426
00000100:00080000:2.0:1776191597.828948:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191597.828952:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191597.828956:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003d78e42e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630945408:0@lo:8:kworker/u8:2.0
00000100:00080000:2.0:1776191597.828965:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191597.828967:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191597.828969:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002460ac97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630945472:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191597.829105:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191597.829115:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004a57869 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630945600:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191597.829144:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191597.829736:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630945600
00000100:00100000:3.0:1776191597.829850:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3324
00000100:00100000:2.0:1776191597.829926:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4887
00000100:00100000:2.0:1776191597.829934:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa41a1c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630945600:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191597.829992:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa41a1c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630945600:12345-0@lo:400:kworker/u8:2.0 Request processed in 58us (847us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191597.830018:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4887
00000100:00100000:3.0:1776191597.830072:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004a57869 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630945600:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191597.835132:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a11d504 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630945344:0@lo:400:kworker/u8:2.0
00010000:00010000:3.0:1776191598.587007:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191599.452323:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191599.452372:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191599.452420:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191599.452501:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613810304
00000100:00100000:0.0:1776191599.452528:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613810368
00000100:00100000:1.0:1776191599.452570:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4888
00000100:00100000:0.0:1776191599.452579:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4889
00000100:00100000:1.0:1776191599.452581:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002460ac97 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613810304:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191599.452589:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003d78e42e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613810368:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191599.452670:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003d78e42e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613810368:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 83us (250us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191599.452678:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4889
00000100:00100000:3.0:1776191599.452833:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613810240
00000100:00100000:3.0:1776191599.452862:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1827
00000100:00100000:3.0:1776191599.452867:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019aa1469 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613810240:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191599.454601:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002460ac97 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613810304:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 2016us (2279us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191599.454617:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4888
00000100:00100000:3.0:1776191599.454894:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019aa1469 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613810240:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 2024us (2519us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191599.454904:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1827
00000100:00100000:0.0:1776191599.455365:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191599.455434:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191599.455668:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613810432
00000100:00100000:3.0:1776191599.455675:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613810496
00000100:00100000:3.0:1776191599.455717:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2105
00000100:00100000:3.0:1776191599.455722:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004a57869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613810432:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191599.455787:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004a57869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613810432:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 64us (424us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191599.455794:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2105
00000100:00100000:3.0:1776191599.455809:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2427
00000100:00100000:3.0:1776191599.455812:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ff26b50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613810496:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:3.0:1776191599.459658:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191599.459744:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ff26b50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613810496:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 3929us (4309us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191599.459759:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2427
00010000:00010000:3.0:1776191599.610677:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191600.634494:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191600.890975:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030c9704c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630945664:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191600.891068:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191600.891280:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630945664
00000100:00100000:3.0:1776191600.891401:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3325
00000100:00100000:3.0:1776191600.891407:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000caebeb11 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630945664:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191600.891445:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191600.891506:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000caebeb11 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630945664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (439us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191600.891513:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3325
00000100:00100000:0.0:1776191600.891595:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030c9704c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630945664:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191601.661869:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191601.916342:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000069339e29 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630945728:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191601.916423:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191601.916618:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630945728
00000100:00100000:3.0:1776191601.916675:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3326
00000100:00100000:3.0:1776191601.916682:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d9f622e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630945728:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191601.916714:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191601.916765:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d9f622e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630945728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (342us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191601.916772:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3326
00000100:00100000:1.0:1776191601.917116:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000069339e29 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630945728:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191602.682510:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191602.938496:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191602.938520:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085501c10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630945856:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191602.938584:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191602.939021:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fb519ed0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630945792:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191602.939070:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191602.941293:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191602.941314:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000af122859 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630945920:0@lo:400:kworker/u8:4.0
00000100:00080000:2.0:1776191602.941339:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191602.941345:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191602.941349:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191602.941354:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4135
00000100:00080000:2.0:1776191602.941357:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191602.941363:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191602.941385:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000e30dc2ee x1862467630946240/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191602.941386:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1776191602.941408:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1776191602.941418:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000552b8f18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630946112:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191602.941456:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191602.941484:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00080000:2.0:1776191602.941485:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191602.941489:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1776191602.941492:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001648d249 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630946176:0@lo:400:kworker/u8:4.0
00000100:00080000:2.0:1776191602.941495:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4135
00000100:00080000:2.0:1776191602.941499:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191602.941502:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191602.941517:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000005783e1b8 x1862467630946304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191602.941528:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191602.941566:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007bb93380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630946048:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191602.941580:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630945856
00000100:00100000:1.0:1776191602.941592:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191602.941609:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4473266 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630946432:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191602.941621:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630945792
00000100:00100000:1.0:1776191602.941634:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191602.941648:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1677
00000100:00100000:2.0:1776191602.941655:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030c9704c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630945856:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191602.941671:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:1.0:1776191602.941678:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000016f04c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630945984:0@lo:400:kworker/u8:4.0
00002000:00000024:2.0:1776191602.941686:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191602.941703:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191602.941720:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000081285d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630946368:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191602.941735:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030c9704c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630945856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (3151us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191602.941745:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1677
00000100:00100000:1.0:1776191602.941755:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191602.941767:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1678
00000100:00100000:2.0:1776191602.941772:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000069339e29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630945792:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191602.941784:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191602.941801:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630946112
00000100:00100000:0.0:1776191602.941803:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630946176
00000100:00100000:2.0:1776191602.941820:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000069339e29 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630945792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (2749us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191602.941827:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1678
00000100:00100000:0.0:1776191602.941837:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630946048
00000100:00100000:1.0:1776191602.941847:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630946432
00000100:00100000:0.0:1776191602.941869:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3327
00000100:00100000:0.0:1776191602.941874:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cfc3317d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630946176:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191602.941879:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630945984
00000100:00100000:1.0:1776191602.941900:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630946368
00000100:00100000:1.0:1776191602.941915:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4890
00000100:00100000:1.0:1776191602.941920:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003f51e2bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630946112:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191602.941925:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cfc3317d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630946176:12345-0@lo:400:kworker/u8:4.0 Request processed in 49us (401us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191602.941933:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3327
00000100:00100000:0.0:1776191602.941951:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3328
00000100:00100000:0.0:1776191602.941956:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c200fc57 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630946048:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191602.941965:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003f51e2bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630946112:12345-0@lo:400:kworker/u8:4.0 Request processed in 43us (507us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191602.941967:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e30dc2ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630946240:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191602.941978:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4890
00000100:00100000:0.0:1776191602.941994:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c200fc57 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630946048:12345-0@lo:400:kworker/u8:4.0 Request processed in 37us (401us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191602.942000:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4891
00000100:00100000:0.0:1776191602.942004:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3328
00000100:00100000:1.0:1776191602.942009:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e61c6045 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630946432:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191602.942012:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191602.942061:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4892
00000100:00100000:2.0:1776191602.942063:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005783e1b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630946304:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191602.942069:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a11d504 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630945984:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191602.942074:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e61c6045 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630946432:12345-0@lo:400:kworker/u8:4.0 Request processed in 67us (440us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191602.942082:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4891
00000100:00100000:2.0:1776191602.942095:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191602.942100:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4893
00000100:00100000:1.0:1776191602.942106:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007cae42a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630946368:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191602.942110:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a11d504 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630945984:12345-0@lo:400:kworker/u8:4.0 Request processed in 40us (405us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191602.942117:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4892
00000100:00100000:0.0:1776191602.942160:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001648d249 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630946176:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191602.942171:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000552b8f18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630946112:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191602.942230:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000016f04c4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630945984:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191602.942239:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007bb93380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630946048:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191602.942250:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4473266 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630946432:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191602.942262:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fb519ed0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630945792:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191602.942302:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630945920
00000100:00100000:0.0:1776191602.942331:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1828
00000100:00100000:0.0:1776191602.942337:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe981ad6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630945920:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191602.942370:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085501c10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630945856:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191602.942387:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007cae42a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630946368:12345-0@lo:400:kworker/u8:4.0 Request processed in 279us (633us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191602.942395:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4893
00000100:00100000:0.0:1776191602.942401:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe981ad6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630945920:12345-0@lo:400:kworker/u8:4.0 Request processed in 62us (1016us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191602.942409:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1828
00000100:00100000:1.0:1776191602.942423:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630946240
00000100:00100000:0.0:1776191602.942447:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000af122859 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630945920:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191602.942447:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630946304
00000100:00100000:1.0:1776191602.942468:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2428
00000100:00100000:1.0:1776191602.942482:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af172616 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630946240:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191602.942497:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2429
00000100:00100000:0.0:1776191602.942501:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dab16da3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630946304:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191602.942583:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000081285d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630946368:0@lo:400:kworker/u8:4.0
00010000:02020000:1.0:1776191602.942741:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191602.942787:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af172616 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630946240:12345-0@lo:8:kworker/u8:4.0 Request processed in 313us (779us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191602.942793:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2428
00010000:02020000:0.0:1776191602.943009:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191602.943066:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dab16da3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630946304:12345-0@lo:8:kworker/u8:4.0 Request processed in 564us (972us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191602.943073:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2429
00000100:00080000:2.0:1776191602.943280:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191602.943285:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191602.943288:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e30dc2ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630946240:0@lo:8:kworker/u8:4.0
00000100:00080000:2.0:1776191602.943296:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191602.943299:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191602.943301:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005783e1b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630946304:0@lo:8:kworker/u8:4.0
00010000:00010000:3.0:1776191603.706615:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191604.572685:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191604.572729:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191604.572767:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191604.572817:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191604.572943:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613810816
00000100:00100000:2.0:1776191604.572983:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613810752
00000100:00100000:2.0:1776191604.573013:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2106
00000100:00100000:2.0:1776191604.573020:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009af94ad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613810752:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191604.573092:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2430
00000100:00100000:3.0:1776191604.573097:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004250bccf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613810816:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00000100:00100000:1.0:1776191604.573198:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613810624
00010000:02020000:3.0:1776191604.573206:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191604.573226:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4894
00000100:00100000:1.0:1776191604.573235:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb519ed0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613810624:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191604.575810:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009af94ad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613810752:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 2781us (3035us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191604.575826:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2106
00000100:00100000:2.0:1776191604.575909:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613810560
00000100:00100000:2.0:1776191604.575963:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1829
00000100:00100000:2.0:1776191604.575969:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001479089e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613810560:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191604.576019:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001479089e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613810560:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 49us (3203us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191604.576026:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1829
00000100:00100000:0.0:1776191604.577112:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191604.577599:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613810688
00000100:00100000:2.0:1776191604.577647:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4895
00000100:00100000:2.0:1776191604.577653:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af122859 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613810688:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191604.577717:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af122859 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613810688:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 63us (610us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191604.577724:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4895
00000100:00100000:1.0:1776191604.583939:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb519ed0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613810624:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 10697us (11252us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191604.583966:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4894
00000100:00100000:3.0:1776191604.584274:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004250bccf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613810816:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 11174us (11544us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191604.584284:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2430
00010000:00010000:3.0:1776191604.731078:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191605.755944:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191606.010472:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1776191606.010488:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085501c10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630946496:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191606.010570:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191606.010666:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630946496
00000100:00100000:1.0:1776191606.010717:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3329
00000100:00100000:1.0:1776191606.010723:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027e578e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630946496:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191606.010754:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191606.010804:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027e578e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630946496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (235us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191606.010811:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3329
00000100:00100000:2.0:1776191606.010897:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085501c10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630946496:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191606.778732:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191607.035246:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae6c8b4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630946560:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191607.035317:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191607.035796:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630946560
00000100:00100000:0.0:1776191607.035850:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3330
00000100:00100000:0.0:1776191607.035856:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a3bd616 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630946560:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191607.036320:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191607.036421:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a3bd616 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630946560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 564us (1106us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191607.036428:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3330
00000100:00100000:2.0:1776191607.036439:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae6c8b4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630946560:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191607.802245:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191608.058745:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005783e1b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630946624:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191608.058818:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191608.059064:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630946624
00000100:00100000:3.0:1776191608.059108:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1679
00000100:00100000:3.0:1776191608.059115:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002fc9e52b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630946624:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191608.059142:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191608.059178:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002fc9e52b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630946624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (361us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191608.059185:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1679
00000100:00100000:0.0:1776191608.059255:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005783e1b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630946624:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191608.059272:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191608.059283:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000081285d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630946688:0@lo:13:osp-pre-0-0.0
00000100:00080000:1.0:1776191608.059316:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1776191608.059321:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191608.059324:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191608.059328:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191608.059333:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4141
00000100:00080000:1.0:1776191608.059335:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191608.059340:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191608.059360:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000418a6d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630946880:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191608.059371:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000d795279f x1862467630947136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191608.059390:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191608.059394:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191608.059396:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191608.059399:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4141
00000100:00080000:1.0:1776191608.059401:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00100000:0.0:1776191608.059407:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191608.059416:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191608.059428:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1776191608.059431:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000b6af7b47 x1862467630947200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191608.059436:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009189961c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630946944:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191608.059476:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009065a894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630946752:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191608.059519:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191608.059547:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c02746a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630947008:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191608.059567:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191608.059583:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:1.0:1776191608.059587:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae6c8b4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630946816:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191608.059610:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191608.059621:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630946752
00000100:00100000:0.0:1776191608.059644:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007416a516 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630947264:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191608.059649:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1830
00000100:00100000:1.0:1776191608.059655:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fc1666bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630946752:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191608.059682:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191608.059692:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fc1666bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630946752:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (172us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191608.059733:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d795279f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630947136:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191608.059762:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191608.059775:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b6af7b47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630947200:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191608.059792:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191608.059823:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630947136
00000100:00100000:1.0:1776191608.059851:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1830
00000100:00100000:1.0:1776191608.059881:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630946880
00000100:00100000:2.0:1776191608.060068:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630947200
00000100:00100000:2.0:1776191608.060083:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2431
00000100:00100000:2.0:1776191608.060086:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000b9cbeaa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630947136:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191608.060193:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191608.060228:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000b9cbeaa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630947136:12345-0@lo:8:kworker/u8:2.0 Request processed in 140us (465us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191608.060234:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2431
00000100:00100000:2.0:1776191608.060246:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2432
00000100:00100000:2.0:1776191608.060250:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d72c3363 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630947200:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191608.060328:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191608.060350:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d72c3363 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630947200:12345-0@lo:8:kworker/u8:2.0 Request processed in 99us (557us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191608.060356:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2432
00000100:00100000:2.0:1776191608.060390:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000150035b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630947328:0@lo:400:kworker/u8:2.0
00000100:00080000:2.0:1776191608.060427:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191608.060431:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191608.060434:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d795279f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630947136:0@lo:8:kworker/u8:2.0
00000100:00080000:2.0:1776191608.060442:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191608.060445:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191608.060447:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b6af7b47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630947200:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191608.061049:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630946688
00000100:00100000:3.0:1776191608.061083:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1680
00000100:00100000:3.0:1776191608.061088:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005783e1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630946688:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191608.061106:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191608.061141:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005783e1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630946688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (1823us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191608.061148:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1680
00000100:00100000:3.0:1776191608.062358:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630946944
00000100:00100000:0.0:1776191608.062459:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000081285d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630946688:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191608.062508:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630947264
00000100:00100000:3.0:1776191608.062672:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4896
00000100:00100000:3.0:1776191608.062678:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e30dc2ee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630946944:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191608.062732:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e30dc2ee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630946944:12345-0@lo:400:kworker/u8:2.0 Request processed in 54us (3262us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191608.062741:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4896
00000100:00100000:1.0:1776191608.062811:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630947008
00000100:00100000:2.0:1776191608.062910:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3331
00000100:00100000:2.0:1776191608.062915:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a4473266 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630946880:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191608.062950:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a4473266 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630946880:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (3544us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191608.062956:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3331
00000100:00100000:2.0:1776191608.062969:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3332
00000100:00100000:2.0:1776191608.062973:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005fd6c919 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630947008:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191608.063000:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005fd6c919 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630947008:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (3433us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191608.063005:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3332
00000100:00100000:2.0:1776191608.063047:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191608.063090:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630947328
00000100:00100000:2.0:1776191608.063112:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4897
00000100:00100000:2.0:1776191608.063116:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e7a43fc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630947328:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191608.063148:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e7a43fc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630947328:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (116us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191608.063153:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4897
00000100:00100000:2.0:1776191608.063190:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000150035b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630947328:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191608.063487:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4898
00000100:00100000:0.0:1776191608.063492:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007bb93380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630947264:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191608.063956:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191608.063976:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007bb93380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630947264:12345-0@lo:400:kworker/u8:2.0 Request processed in 481us (4304us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191608.063985:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4898
00000100:00100000:0.0:1776191608.064013:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630946816
00000100:00100000:1.0:1776191608.064023:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000161dca59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630947072:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191608.064079:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191608.064136:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630947072
00000100:00100000:3.0:1776191608.064165:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2107
00000100:00100000:3.0:1776191608.064169:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027f5d17c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630947072:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191608.064201:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027f5d17c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630947072:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (121us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191608.064207:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2107
00000100:00100000:1.0:1776191608.064254:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009065a894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630946752:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191608.064269:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c02746a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630947008:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191608.064291:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000161dca59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630947072:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191608.064326:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007416a516 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630947264:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191608.064336:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009189961c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630946944:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191608.064346:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000418a6d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630946880:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191608.064468:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4899
00000100:00100000:0.0:1776191608.064473:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000baaea16f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630946816:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191608.064641:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000baaea16f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630946816:12345-0@lo:400:kworker/u8:2.0 Request processed in 167us (685us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191608.064649:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4899
00000100:00100000:1.0:1776191608.068913:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae6c8b4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630946816:0@lo:400:kworker/u8:2.0
00010000:00010000:3.0:1776191608.826897:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191609.692083:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191609.692130:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191609.692222:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613810880
00000100:00100000:3.0:1776191609.692277:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1831
00000100:00100000:3.0:1776191609.692285:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000280cef61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613810880:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191609.692368:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000280cef61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613810880:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 83us (339us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191609.692376:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1831
00000100:00100000:0.0:1776191609.692972:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191609.694073:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613811008
00000100:00100000:0.0:1776191609.694086:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191609.694113:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191609.694122:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613810944
00000100:00100000:0.0:1776191609.694146:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613811072
00000100:00100000:3.0:1776191609.694154:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4900
00000100:00100000:3.0:1776191609.694160:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016f04c4f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613811008:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191609.694223:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016f04c4f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613811008:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 63us (2093us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191609.694231:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4900
00000100:00100000:3.0:1776191609.694245:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4901
00000100:00100000:3.0:1776191609.694249:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000552b8f18 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613810944:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191609.694272:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000552b8f18 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613810944:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 23us (1302us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191609.694279:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4901
00000100:00100000:2.0:1776191609.694369:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613811136
00000100:00100000:2.0:1776191609.694403:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2433
00000100:00100000:2.0:1776191609.694408:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000081285d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613811136:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:2.0:1776191609.694504:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191609.694549:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000081285d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613811136:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 140us (435us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191609.694556:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2433
00000100:00100000:0.0:1776191609.694647:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2108
00000100:00100000:0.0:1776191609.694653:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001648d249 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613811072:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191609.694680:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001648d249 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613811072:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 27us (597us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191609.694686:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2108
00010000:00010000:3.0:1776191609.851129:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191610.875388:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191611.130325:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085501c10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630947392:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191611.130402:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191611.130597:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630947392
00000100:00100000:3.0:1776191611.130707:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3333
00000100:00100000:3.0:1776191611.130714:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007416a516 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630947392:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191611.130748:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191611.130800:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007416a516 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630947392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (399us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191611.130807:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3333
00000100:00100000:1.0:1776191611.130876:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085501c10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630947392:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191611.901400:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191612.155177:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776191612.155386:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ad77ca4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630947456:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191612.155465:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191612.156471:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630947456
00000100:00100000:3.0:1776191612.156528:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3334
00000100:00100000:3.0:1776191612.156534:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ed42626 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630947456:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191612.156570:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191612.156813:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ed42626 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630947456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 277us (1347us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191612.156820:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3334
00000100:00100000:1.0:1776191612.157194:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ad77ca4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630947456:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191612.922231:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191613.178235:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ad77ca4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630947520:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191613.178324:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191613.178361:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a81e70bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630947584:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191613.178380:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630947520
00000100:00100000:3.0:1776191613.178382:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191613.178414:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630947584
00000100:00100000:1.0:1776191613.178419:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1681
00000100:00100000:1.0:1776191613.178425:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085501c10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630947520:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191613.178432:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1682
00000100:00100000:3.0:1776191613.178435:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001105f678 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630947584:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191613.178452:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00002000:00000024:3.0:1776191613.178452:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191613.178494:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085501c10 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630947520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (171us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191613.178501:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1681
00000100:00100000:3.0:1776191613.178552:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001105f678 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630947584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (169us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191613.178559:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1682
00000100:00080000:2.0:1776191613.178729:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191613.178734:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191613.178737:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191613.178741:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4146
00000100:00080000:2.0:1776191613.178744:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191613.178747:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191613.178766:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000004270d9b1 x1862467630947968/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191613.178779:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191613.178782:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191613.178783:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191613.178786:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4146
00000100:00080000:2.0:1776191613.178787:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191613.178790:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191613.178799:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000008eb36e2d x1862467630948032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191613.178832:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008bacde2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630947776:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191613.178863:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191613.178880:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003824609a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630948160:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191613.178902:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191613.178918:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:2.0:1776191613.178922:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6387b57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630947712:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191613.178942:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191613.178957:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a6e01f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630948096:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191613.178978:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191613.179000:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004270d9b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630947968:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191613.179025:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191613.179062:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008eb36e2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630948032:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191613.179095:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191613.179123:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630947776
00000100:00100000:2.0:1776191613.179149:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3335
00000100:00100000:2.0:1776191613.179153:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093500675 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630947776:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191613.179195:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093500675 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630947776:12345-0@lo:400:kworker/u8:2.0 Request processed in 41us (332us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191613.179200:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3335
00000100:00100000:2.0:1776191613.179220:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630948160
00000100:00100000:2.0:1776191613.179263:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630947712
00000100:00100000:2.0:1776191613.179284:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630948096
00000100:00100000:2.0:1776191613.179302:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4902
00000100:00100000:2.0:1776191613.179306:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b6af7b47 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630948160:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191613.179341:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b6af7b47 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630948160:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (438us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191613.179347:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4902
00000100:00100000:2.0:1776191613.179359:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4903
00000100:00100000:2.0:1776191613.179362:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d795279f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630947712:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191613.179386:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d795279f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630947712:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (444us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191613.179392:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4903
00000100:00100000:2.0:1776191613.179401:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4904
00000100:00100000:2.0:1776191613.179404:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe1c3a77 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630948096:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191613.179424:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe1c3a77 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630948096:12345-0@lo:400:kworker/u8:2.0 Request processed in 20us (446us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191613.179430:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4904
00000100:00100000:2.0:1776191613.179453:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630947968
00000100:00100000:2.0:1776191613.179470:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630948032
00000100:00100000:2.0:1776191613.179482:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2434
00000100:00100000:2.0:1776191613.179485:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003f76256d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630947968:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191613.179577:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191613.179609:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003f76256d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630947968:12345-0@lo:8:kworker/u8:2.0 Request processed in 123us (584us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191613.179615:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2434
00000100:00100000:2.0:1776191613.179735:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2435
00000100:00100000:2.0:1776191613.179739:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000128cb0b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630948032:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191613.179827:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191613.179852:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000128cb0b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630948032:12345-0@lo:8:kworker/u8:2.0 Request processed in 111us (756us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191613.179857:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2435
00000100:00080000:2.0:1776191613.179909:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191613.179913:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191613.179917:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004270d9b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630947968:0@lo:8:kworker/u8:2.0
00000100:00080000:2.0:1776191613.179925:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191613.179927:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191613.179929:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008eb36e2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630948032:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191613.179960:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6387b57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630947712:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191613.179969:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a6e01f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630948096:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191613.179977:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008bacde2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630947776:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191613.179984:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003824609a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630948160:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191613.180374:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d475367 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630947840:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191613.180409:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191613.180444:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ad77ca4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630947520:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191613.180458:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a81e70bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630947584:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191613.180476:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:1.0:1776191613.180481:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f93569a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630947648:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191613.180507:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191613.180522:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008058b273 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630947904:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191613.180560:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630947840
00000100:00100000:3.0:1776191613.180594:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4905
00000100:00100000:3.0:1776191613.180612:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3e12bd4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630947840:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191613.180647:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3e12bd4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630947840:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (239us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191613.180653:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4905
00000100:00100000:3.0:1776191613.180693:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630947648
00000100:00100000:3.0:1776191613.180714:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1832
00000100:00100000:3.0:1776191613.180718:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ea296a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630947648:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191613.180745:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ea296a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630947648:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (238us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191613.180750:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1832
00000100:00100000:1.0:1776191613.180907:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191613.180938:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d475367 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630947840:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191613.180953:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f93569a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630947648:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191613.181269:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630947904
00000100:00100000:0.0:1776191613.181306:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3336
00000100:00100000:0.0:1776191613.181311:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ad77ca4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630947904:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191613.181348:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ad77ca4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630947904:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (442us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191613.181353:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3336
00000100:00100000:1.0:1776191613.181514:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008058b273 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630947904:0@lo:400:kworker/u8:2.0
00010000:00010000:3.0:1776191613.950052:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191614.813132:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191614.813189:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191614.813311:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613811456
00000100:00100000:2.0:1776191614.813364:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2436
00000100:00100000:2.0:1776191614.813370:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029599f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613811456:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:2.0:1776191614.813475:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191614.813539:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029599f7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613811456:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 168us (415us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191614.813546:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2436
00000100:00100000:3.0:1776191614.814233:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191614.814311:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191614.814362:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191614.814408:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613811200
00000100:00100000:2.0:1776191614.814443:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1833
00000100:00100000:2.0:1776191614.814448:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e58aa936 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613811200:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191614.814491:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e58aa936 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613811200:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 42us (181us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191614.814498:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1833
00000100:00100000:1.0:1776191614.816701:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613811392
00000100:00100000:1.0:1776191614.817098:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2109
00000100:00100000:1.0:1776191614.817113:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049908ee0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613811392:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191614.817289:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049908ee0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613811392:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 177us (3058us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191614.817297:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2109
00000100:00100000:0.0:1776191614.817858:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613811264
00000100:00100000:1.0:1776191614.820937:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613811328
00000100:00100000:1.0:1776191614.821015:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4906
00000100:00100000:1.0:1776191614.821022:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f2477cb3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613811264:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191614.821144:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f2477cb3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613811264:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 114us (7948us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191614.821153:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4906
00000100:00100000:1.0:1776191614.821174:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4907
00000100:00100000:1.0:1776191614.821179:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005112615a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613811328:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191614.821205:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005112615a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613811328:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 26us (6844us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191614.821212:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4907
00010000:00010000:3.0:1776191614.970516:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191615.999943:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191616.252162:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191616.252205:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000001c99791 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630948224:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191616.252284:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191616.252660:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630948224
00000100:00100000:2.0:1776191616.252710:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3337
00000100:00100000:2.0:1776191616.252717:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b5928219 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630948224:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191616.252753:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191616.252821:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b5928219 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630948224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (537us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191616.252828:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3337
00000100:00100000:1.0:1776191616.254565:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000001c99791 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630948224:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191617.018574:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191617.274244:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000259772a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630948288:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191617.274313:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191617.274411:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630948288
00000100:00100000:0.0:1776191617.274458:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3338
00000100:00100000:0.0:1776191617.274463:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ea65731 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630948288:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191617.274493:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191617.274553:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ea65731 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630948288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (241us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191617.274560:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3338
00000100:00100000:1.0:1776191617.274686:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000259772a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630948288:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191618.042363:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191618.299885:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000259772a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630948352:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191618.299966:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191618.300358:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630948352
00000100:00100000:1.0:1776191618.300372:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191618.300378:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027f5d17c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630948416:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191618.300397:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1683
00000100:00100000:0.0:1776191618.300403:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000365abfb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630948352:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191618.300408:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00002000:00000024:0.0:1776191618.300431:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191618.300432:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630948416
00000100:00100000:1.0:1776191618.300466:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1684
00000100:00100000:1.0:1776191618.300470:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000150035b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630948416:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191618.300472:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000365abfb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630948352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (509us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191618.300478:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1683
00002000:00000024:1.0:1776191618.300480:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191618.300502:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000150035b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630948416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 31us (93us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191618.300508:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1684
00000100:00100000:0.0:1776191618.300524:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027f5d17c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630948416:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191618.300538:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000259772a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630948352:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1776191618.300889:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191618.300894:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191618.300897:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191618.300901:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4151
00000100:00080000:3.0:1776191618.300903:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191618.300907:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191618.300926:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000a0f2d502 x1862467630948800/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191618.300939:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191618.300942:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191618.300943:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191618.300946:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4151
00000100:00080000:3.0:1776191618.300947:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191618.300950:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191618.300959:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000c0aeb4f4 x1862467630948864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191618.301361:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d1c8a441 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630948672:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191618.301403:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191618.301434:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:2.0:1776191618.301439:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009d908df0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630948608:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191618.301461:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191618.301477:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a0236b56 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630948992:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191618.301495:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191618.301515:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a0f2d502 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630948800:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191618.301538:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191618.301552:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0aeb4f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630948864:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191618.301570:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191618.301595:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630948608
00000100:00100000:2.0:1776191618.301622:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3339
00000100:00100000:2.0:1776191618.301627:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030eda894 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630948608:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191618.301668:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030eda894 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630948608:12345-0@lo:400:kworker/u8:4.0 Request processed in 40us (206us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191618.301674:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3339
00000100:00100000:2.0:1776191618.301696:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630948800
00000100:00100000:2.0:1776191618.301715:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630948864
00000100:00100000:2.0:1776191618.301729:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2437
00000100:00100000:2.0:1776191618.301733:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000067aab686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630948800:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191618.301820:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191618.301852:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000067aab686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630948800:12345-0@lo:8:kworker/u8:4.0 Request processed in 118us (314us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191618.301858:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2437
00000100:00100000:2.0:1776191618.301869:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2438
00000100:00100000:2.0:1776191618.301872:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f7c58b5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630948864:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191618.301948:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191618.301969:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f7c58b5d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630948864:12345-0@lo:8:kworker/u8:4.0 Request processed in 96us (399us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191618.301974:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2438
00000100:00080000:2.0:1776191618.302006:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191618.302009:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191618.302012:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a0f2d502 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630948800:0@lo:8:kworker/u8:4.0
00000100:00080000:2.0:1776191618.302020:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191618.302022:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191618.302024:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0aeb4f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630948864:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191618.302083:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009d908df0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630948608:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191618.302719:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630948672
00000100:00100000:3.0:1776191618.302758:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630948992
00000100:00100000:3.0:1776191618.302777:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4908
00000100:00100000:3.0:1776191618.302782:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ef9b9d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630948672:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191618.302829:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ef9b9d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630948672:12345-0@lo:400:kworker/u8:4.0 Request processed in 46us (1426us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191618.302835:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4908
00000100:00100000:3.0:1776191618.302847:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4909
00000100:00100000:3.0:1776191618.302851:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f0579a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630948992:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191618.302875:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f0579a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630948992:12345-0@lo:400:kworker/u8:4.0 Request processed in 24us (1380us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191618.302881:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4909
00000100:00100000:3.0:1776191618.302914:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a0236b56 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630948992:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191618.302925:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d1c8a441 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630948672:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191618.303021:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023dd469f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630948544:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191618.303078:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191618.303104:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c2466414 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630948928:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191618.303124:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191618.303151:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:0.0:1776191618.303157:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008a102519 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630948480:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191618.303183:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191618.303198:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000001c99791 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630948736:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191618.303224:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191618.303250:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630948480
00000100:00100000:0.0:1776191618.303276:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1834
00000100:00100000:0.0:1776191618.303279:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae4705ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630948480:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191618.303311:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae4705ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630948480:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (128us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191618.303331:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1834
00000100:00100000:0.0:1776191618.303360:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630948544
00000100:00100000:0.0:1776191618.303380:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630948928
00000100:00100000:0.0:1776191618.303398:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4910
00000100:00100000:0.0:1776191618.303402:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019e5e056 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630948544:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191618.303431:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019e5e056 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630948544:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (353us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191618.303437:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4910
00000100:00100000:0.0:1776191618.303448:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4911
00000100:00100000:0.0:1776191618.303452:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a81e70bb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630948928:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191618.303476:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a81e70bb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630948928:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (351us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191618.303482:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4911
00000100:00100000:0.0:1776191618.303502:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630948736
00000100:00100000:0.0:1776191618.303524:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3340
00000100:00100000:0.0:1776191618.303528:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4e82865 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630948736:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191618.303557:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4e82865 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630948736:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (332us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191618.303563:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3340
00000100:00100000:0.0:1776191618.303590:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008a102519 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630948480:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191618.303600:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000001c99791 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630948736:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191618.303609:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023dd469f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630948544:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191618.303617:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c2466414 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630948928:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191619.066540:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191619.931980:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191619.932079:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191619.932117:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191619.932139:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191619.932164:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191619.932196:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613811648
00000100:00100000:2.0:1776191619.932240:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613811584
00000100:00100000:2.0:1776191619.932262:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4912
00000100:00100000:2.0:1776191619.932268:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000001c99791 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613811648:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191619.932368:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000001c99791 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613811648:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 99us (260us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191619.932375:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4912
00000100:00100000:2.0:1776191619.932394:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4913
00000100:00100000:2.0:1776191619.932398:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a102519 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613811584:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191619.932434:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a102519 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613811584:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 35us (295us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191619.932440:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4913
00000100:00100000:2.0:1776191619.932461:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613811776
00000100:00100000:2.0:1776191619.932479:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613811712
00000100:00100000:2.0:1776191619.932499:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2110
00000100:00100000:2.0:1776191619.932503:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d1c8a441 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613811712:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191619.932529:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d1c8a441 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613811712:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 25us (365us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191619.932535:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2110
00000100:00100000:2.0:1776191619.932547:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2439
00000100:00100000:2.0:1776191619.932551:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000023dd469f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613811776:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:2.0:1776191619.932648:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191619.932676:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000023dd469f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613811776:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 123us (703us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191619.932682:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2439
00000100:00100000:0.0:1776191619.933971:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613811520
00000100:00100000:0.0:1776191619.934031:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1835
00000100:00100000:0.0:1776191619.934054:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000deab4b38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613811520:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191619.934122:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000deab4b38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613811520:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 68us (2091us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191619.934130:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1835
00010000:00010000:3.0:1776191620.090340:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191621.114254:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191621.375227:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776191621.375254:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a0236b56 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630949056:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191621.375334:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191621.375725:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630949056
00000100:00100000:1.0:1776191621.375785:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3341
00000100:00100000:1.0:1776191621.375790:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000038340710 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630949056:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191621.375822:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191621.375877:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000038340710 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630949056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (543us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191621.375883:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3341
00000100:00100000:2.0:1776191621.375966:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a0236b56 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630949056:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191622.138969:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191622.394659:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191622.394675:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000259772a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630949120:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191622.394745:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191622.395111:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630949120
00000100:00100000:1.0:1776191622.395166:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3342
00000100:00100000:1.0:1776191622.395172:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004a57869 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630949120:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191622.395214:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191622.395270:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004a57869 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630949120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (526us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191622.395277:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3342
00000100:00100000:2.0:1776191622.395474:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000259772a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630949120:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191623.162271:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191623.419720:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000af172616 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630949184:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191623.419791:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191623.419893:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630949184
00000100:00100000:0.0:1776191623.419947:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1685
00000100:00100000:0.0:1776191623.419952:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d908df0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630949184:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191623.419982:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191623.420061:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d908df0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630949184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (271us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191623.420068:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1685
00000100:00100000:2.0:1776191623.420274:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1776191623.420284:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027f5d17c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630949248:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191623.420313:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191623.420374:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000af172616 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630949184:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191623.420603:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630949248
00000100:00100000:1.0:1776191623.420640:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1686
00000100:00100000:1.0:1776191623.420645:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007756d7ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630949248:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191623.420659:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191623.420694:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007756d7ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630949248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (380us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191623.420699:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1686
00000100:00080000:2.0:1776191623.420953:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191623.420957:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191623.420961:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191623.420965:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4156
00000100:00080000:2.0:1776191623.420967:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191623.420971:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191623.420988:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000481c290f x1862467630949632/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191623.421002:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191623.421005:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191623.421006:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191623.421008:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4156
00000100:00080000:2.0:1776191623.421010:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191623.421023:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191623.421067:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000011eb3cbb x1862467630949696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191623.421100:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000481c290f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630949632:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191623.421128:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191623.421145:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011eb3cbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630949696:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191623.421164:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191623.421189:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630949632
00000100:00100000:2.0:1776191623.421207:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630949696
00000100:00100000:2.0:1776191623.421220:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2440
00000100:00100000:2.0:1776191623.421225:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a426c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630949632:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191623.421321:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191623.421525:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4d9e8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630949504:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191623.421557:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191623.421576:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:3.0:1776191623.421581:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004905ea34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630949312:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191623.421604:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191623.421616:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630949568:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191623.421635:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191623.421659:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630949504
00000100:00100000:3.0:1776191623.421688:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4914
00000100:00100000:3.0:1776191623.421692:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000061ace3cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630949504:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191623.421729:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000061ace3cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630949504:12345-0@lo:400:kworker/u8:4.0 Request processed in 35us (171us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191623.421735:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4914
00000100:00100000:3.0:1776191623.421766:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4d9e8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630949504:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191623.421803:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2441
00000100:00100000:3.0:1776191623.421807:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a0c5ca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630949696:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191623.421892:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191623.421922:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a0c5ca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630949696:12345-0@lo:8:kworker/u8:4.0 Request processed in 114us (758us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191623.421928:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2441
00000100:00100000:3.0:1776191623.421960:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027f5d17c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630949248:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191623.421978:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000be03407 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630949440:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191623.421999:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191623.422028:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000939787e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630949824:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191623.422081:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191623.422096:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:3.0:1776191623.422100:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d71ef7e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630949376:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191623.422119:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191623.422131:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000859dbd41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630949760:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191623.422149:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191623.422173:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630949824
00000100:00100000:3.0:1776191623.422277:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630949376
00000100:00100000:3.0:1776191623.422292:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630949760
00000100:00100000:3.0:1776191623.422308:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4915
00000100:00100000:3.0:1776191623.422312:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0aeb4f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630949824:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191623.422357:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0aeb4f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630949824:12345-0@lo:400:kworker/u8:4.0 Request processed in 44us (275us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191623.422363:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4915
00000100:00100000:3.0:1776191623.422375:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4916
00000100:00100000:3.0:1776191623.422378:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a0f2d502 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630949376:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191623.422402:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a0f2d502 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630949376:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (282us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191623.422407:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4916
00000100:00100000:3.0:1776191623.422417:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4917
00000100:00100000:3.0:1776191623.422420:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a4d9e8c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630949760:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191623.422446:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a4d9e8c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630949760:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (297us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191623.422451:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4917
00000100:00100000:3.0:1776191623.422479:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d71ef7e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630949376:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191623.422487:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000859dbd41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630949760:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191623.422501:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000939787e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630949824:0@lo:400:kworker/u8:4.0
00000100:00080000:3.0:1776191623.422552:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191623.422556:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191623.422559:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011eb3cbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630949696:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191623.422588:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630949568
00000100:00100000:2.0:1776191623.422649:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a426c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630949632:12345-0@lo:8:kworker/u8:4.0 Request processed in 1424us (1521us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191623.422657:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2440
00000100:00080000:2.0:1776191623.422680:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191623.422682:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191623.422685:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000481c290f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630949632:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191623.422780:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630949440
00000100:00100000:0.0:1776191623.422803:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3343
00000100:00100000:0.0:1776191623.422807:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c2466414 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630949440:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191623.422850:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c2466414 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630949440:12345-0@lo:400:kworker/u8:4.0 Request processed in 42us (850us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191623.422855:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3343
00000100:00100000:1.0:1776191623.423008:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630949312
00000100:00100000:1.0:1776191623.423071:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1836
00000100:00100000:1.0:1776191623.423075:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a4afbcc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630949312:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191623.423115:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a4afbcc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630949312:12345-0@lo:400:kworker/u8:4.0 Request processed in 39us (1510us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191623.423122:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1836
00000100:00100000:1.0:1776191623.423165:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004905ea34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630949312:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191623.423247:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3344
00000100:00100000:3.0:1776191623.423251:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a0236b56 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630949568:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191623.423287:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a0236b56 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630949568:12345-0@lo:400:kworker/u8:4.0 Request processed in 36us (1652us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191623.423292:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3344
00000100:00100000:1.0:1776191623.423462:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630949568:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191623.423533:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000be03407 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630949440:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191624.189085:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191625.053259:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191625.053317:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191625.053353:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191625.053383:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191625.053412:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191625.053444:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613811904
00000100:00100000:1.0:1776191625.053485:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613811840
00000100:00100000:2.0:1776191625.053493:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613811968
00000100:00100000:1.0:1776191625.053527:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1837
00000100:00100000:2.0:1776191625.053527:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4918
00000100:00100000:2.0:1776191625.053542:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000939787e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613811904:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191625.053543:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dbba1dca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613811840:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191625.053616:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000939787e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613811904:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 79us (261us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191625.053624:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4918
00000100:00100000:3.0:1776191625.053635:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4919
00000100:00100000:3.0:1776191625.053642:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000859dbd41 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613811968:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191625.053719:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613812032
00000100:00100000:1.0:1776191625.053733:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dbba1dca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613811840:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 196us (414us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191625.053741:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1837
00000100:00100000:0.0:1776191625.053751:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2111
00000100:00100000:0.0:1776191625.053756:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008dbfa9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613812032:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191625.053788:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008dbfa9ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613812032:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 31us (377us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191625.053794:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2111
00000100:00100000:3.0:1776191625.054221:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000859dbd41 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613811968:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 578us (836us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191625.054229:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4919
00000100:00100000:2.0:1776191625.055079:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613812096
00000100:00100000:2.0:1776191625.055129:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2442
00000100:00100000:2.0:1776191625.055135:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a6d843e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613812096:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:2.0:1776191625.055758:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191625.055827:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a6d843e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613812096:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 692us (2576us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191625.055837:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2442
00010000:00010000:3.0:1776191625.212935:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191626.234240:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191626.494636:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d71ef7e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630949888:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191626.494720:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191626.494931:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630949888
00000100:00100000:0.0:1776191626.495023:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3345
00000100:00100000:0.0:1776191626.495030:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027f5d17c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630949888:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191626.495088:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191626.495136:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027f5d17c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630949888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (418us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191626.495143:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3345
00000100:00100000:1.0:1776191626.495212:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d71ef7e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630949888:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191627.258365:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191627.514438:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191627.514455:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000259772a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630949952:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191627.514535:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191627.514719:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630949952
00000100:00100000:0.0:1776191627.514770:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3346
00000100:00100000:0.0:1776191627.514775:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d71ef7e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630949952:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191627.514807:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191627.514864:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d71ef7e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630949952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (329us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191627.514870:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3346
00000100:00100000:1.0:1776191627.514967:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000259772a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630949952:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191628.282561:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191628.538937:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000259772a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630950016:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191628.539008:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191628.539071:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630950016
00000100:00100000:2.0:1776191628.539081:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1776191628.539089:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000be03407 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630950080:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191628.539120:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1687
00000100:00100000:1.0:1776191628.539132:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ea373370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630950016:12345-0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1776191628.539135:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1776191628.539137:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1776191628.539143:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191628.539148:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191628.539153:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4161
00000100:00080000:3.0:1776191628.539157:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191628.539163:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00002000:00000024:1.0:1776191628.539168:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191628.539213:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ea373370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630950016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (205us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191628.539221:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1687
00000100:00100000:0.0:1776191628.539244:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011eb3cbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630950336:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191628.539264:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630950080
00000100:00100000:0.0:1776191628.539280:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191628.539291:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1838
00000100:00100000:1.0:1776191628.539296:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b9375c8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630950080:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191628.539311:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191628.539318:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000481c290f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630950272:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191628.539330:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b9375c8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630950080:12345-0@lo:400:kworker/u8:4.0 Request processed in 32us (200us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191628.539338:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1838
00000100:00100000:0.0:1776191628.539349:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191628.539372:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004905ea34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630950208:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191628.539399:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191628.539402:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630950272
00000100:00100000:1.0:1776191628.539432:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dab16da3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630950464:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191628.539437:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4920
00000100:00100000:0.0:1776191628.539442:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008058b273 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630950272:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191628.539459:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191628.539480:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:0.0:1776191628.539488:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008058b273 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630950272:12345-0@lo:400:kworker/u8:4.0 Request processed in 44us (139us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191628.539489:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630950144:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191628.539500:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4920
00000100:00100000:1.0:1776191628.539521:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191628.539524:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630950336
00000100:00100000:1.0:1776191628.539541:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d0e4254d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630950400:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191628.539561:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630950208
00000100:00100000:0.0:1776191628.539576:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3347
00000100:00100000:0.0:1776191628.539580:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af172616 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630950336:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191628.539610:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af172616 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630950336:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (332us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191628.539616:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3347
00000100:00100000:0.0:1776191628.539626:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3348
00000100:00100000:0.0:1776191628.539630:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000418a6d34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630950208:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191628.539653:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000418a6d34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630950208:12345-0@lo:400:kworker/u8:4.0 Request processed in 22us (254us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191628.539658:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3348
00000100:00100000:0.0:1776191628.539676:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630950144
00000100:00100000:0.0:1776191628.539697:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4921
00000100:00100000:0.0:1776191628.539701:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000161dca59 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630950144:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191628.539728:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000161dca59 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630950144:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (210us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191628.539734:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4921
00000100:00100000:0.0:1776191628.539775:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000481c290f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630950272:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191628.539785:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011eb3cbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630950336:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191628.539823:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630950464
00000100:00100000:0.0:1776191628.539843:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1688
00000100:00100000:0.0:1776191628.539846:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009189961c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630950464:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191628.539857:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191628.539881:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009189961c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630950464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (424us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191628.539887:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1688
00000100:00100000:1.0:1776191628.539915:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191628.539955:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630950400
00000100:00100000:1.0:1776191628.539961:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004905ea34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630950208:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191628.539981:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dab16da3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630950464:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191628.539985:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2112
00000100:00100000:0.0:1776191628.539992:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c02746a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630950400:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191628.540009:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630950144:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191628.540031:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0e4254d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630950400:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191628.540054:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c02746a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630950400:12345-0@lo:400:kworker/u8:4.0 Request processed in 38us (118us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191628.540060:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2112
00000100:00100000:2.0:1776191628.544616:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000be03407 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630950080:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191628.544646:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000259772a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630950016:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191628.546310:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000e3653833 x1862467630950528/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191628.546379:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191628.546384:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191628.546387:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191628.546392:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4161
00000100:00080000:3.0:1776191628.546394:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191628.546400:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191628.546480:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000009ff26b50 x1862467630950592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191628.546657:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e3653833 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630950528:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191628.546687:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009af94ad9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630950656:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191628.546720:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191628.546720:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191628.546743:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ff26b50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630950592:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191628.546762:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191628.546817:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630950528
00000100:00100000:2.0:1776191628.546853:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2443
00000100:00100000:2.0:1776191628.546860:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000259772a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630950528:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191628.546893:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191628.546899:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004250bccf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630950720:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191628.546936:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191628.546961:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630950656
00010000:02020000:2.0:1776191628.546969:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191628.546988:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630950720
00000100:00100000:0.0:1776191628.547005:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4922
00000100:00100000:0.0:1776191628.547008:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f93569a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630950656:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191628.547008:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000259772a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630950528:12345-0@lo:8:kworker/u8:4.0 Request processed in 148us (289us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191628.547014:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2443
00000100:00100000:2.0:1776191628.547057:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4923
00000100:00100000:2.0:1776191628.547061:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d475367 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630950720:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191628.547064:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f93569a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630950656:12345-0@lo:400:kworker/u8:4.0 Request processed in 55us (345us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191628.547069:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4922
00000100:00100000:2.0:1776191628.547089:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d475367 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630950720:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (154us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191628.547095:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4923
00000100:00100000:0.0:1776191628.547104:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004250bccf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630950720:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191628.547113:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009af94ad9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630950656:0@lo:400:kworker/u8:4.0
00000100:00080000:2.0:1776191628.547130:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191628.547133:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191628.547136:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e3653833 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630950528:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191628.547362:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630950592
00000100:00100000:1.0:1776191628.547394:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2444
00000100:00100000:1.0:1776191628.547398:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc840106 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630950592:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191628.547493:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191628.547537:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc840106 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630950592:12345-0@lo:8:kworker/u8:4.0 Request processed in 138us (774us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191628.547542:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2444
00000100:00080000:3.0:1776191628.549614:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191628.549624:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191628.549631:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ff26b50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630950592:0@lo:8:kworker/u8:4.0
00010000:00010000:3.0:1776191629.306241:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191630.171775:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191630.171827:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191630.171856:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191630.171926:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191630.172003:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191630.172071:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613812352
00000100:00100000:2.0:1776191630.172117:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613812416
00000100:00100000:2.0:1776191630.172136:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2113
00000100:00100000:2.0:1776191630.172143:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000205ceda0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613812352:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191630.172212:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000205ceda0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613812352:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 69us (286us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191630.172220:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2113
00000100:00100000:2.0:1776191630.172239:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2445
00000100:00100000:2.0:1776191630.172243:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a2346a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613812416:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:2.0:1776191630.172362:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191630.172390:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a2346a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613812416:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 146us (387us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191630.172396:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2445
00000100:00100000:1.0:1776191630.172472:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613812224
00000100:00100000:1.0:1776191630.172515:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613812288
00000100:00100000:1.0:1776191630.172541:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4924
00000100:00100000:1.0:1776191630.172550:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000081285d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613812224:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191630.172581:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000081285d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613812224:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 30us (755us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191630.172587:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4924
00000100:00100000:1.0:1776191630.172598:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4925
00000100:00100000:1.0:1776191630.172602:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001648d249 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613812288:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191630.172628:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001648d249 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613812288:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 25us (772us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191630.172634:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4925
00000100:00100000:0.0:1776191630.173077:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613812160
00000100:00100000:0.0:1776191630.173103:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1839
00000100:00100000:0.0:1776191630.173108:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fec76140 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613812160:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191630.173149:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fec76140 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613812160:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 40us (1382us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191630.173156:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1839
00010000:00010000:3.0:1776191630.330260:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191631.354331:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191631.610530:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ff26b50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630950784:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191631.610909:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191631.611787:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630950784
00000100:00100000:2.0:1776191631.612565:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3349
00000100:00100000:2.0:1776191631.612571:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003824609a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630950784:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191631.612607:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191631.612738:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003824609a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630950784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 165us (1830us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191631.612747:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3349
00000100:00100000:1.0:1776191631.614200:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ff26b50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630950784:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191632.378336:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191632.634316:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dab16da3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630950848:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191632.634385:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191632.636619:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630950848
00000100:00100000:0.0:1776191632.636677:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3350
00000100:00100000:0.0:1776191632.636683:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ff26b50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630950848:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191632.636719:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191632.636796:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ff26b50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630950848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (2412us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191632.636803:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3350
00000100:00100000:3.0:1776191632.638664:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dab16da3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630950848:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191633.402245:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191633.658580:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776191633.658713:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dab16da3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630951040:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191633.658772:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064912ce2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630950976:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191633.658779:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1776191633.658859:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191633.658864:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191633.658867:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191633.658873:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4166
00000100:00080000:2.0:1776191633.658876:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191633.658882:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191633.658902:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000b1bce22f x1862467630951488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191633.658917:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191633.658920:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191633.658923:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191633.658925:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4166
00000100:00080000:2.0:1776191633.658927:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191633.658929:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191633.658938:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000037d67e5b x1862467630951552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191633.658985:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a9c33ce9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630951104:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191633.659130:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f77bc1c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630951168:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191633.659252:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191633.659273:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b3fa5790 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630951360:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191633.659293:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191633.659305:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191633.659317:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008bacde2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630951424:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191633.659329:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:2.0:1776191633.659337:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007a66bc0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630951296:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191633.659347:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191633.659368:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191633.659373:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:0.0:1776191633.659380:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005f28ffee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630951232:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191633.659390:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004172df30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630951680:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191633.659410:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191633.659426:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191633.659431:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000182c146b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630951616:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191633.659459:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191633.659463:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630951104
00000100:00100000:0.0:1776191633.659488:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630951232
00000100:00100000:2.0:1776191633.659516:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3351
00000100:00100000:2.0:1776191633.659522:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004a7f95d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630951104:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191633.659545:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630951040
00000100:00100000:1.0:1776191633.659571:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630951424
00000100:00100000:2.0:1776191633.659588:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004a7f95d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630951104:12345-0@lo:400:kworker/u8:4.0 Request processed in 65us (336us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191633.659595:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1689
00000100:00100000:2.0:1776191633.659602:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3351
00000100:00100000:1.0:1776191633.659603:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000be03407 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630951040:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191633.659624:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3352
00002000:00000024:1.0:1776191633.659626:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191633.659631:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008eb36e2d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630951232:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191633.659676:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000be03407 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630951040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (898us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191633.659682:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008eb36e2d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630951232:12345-0@lo:400:kworker/u8:4.0 Request processed in 50us (271us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191633.659688:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1689
00000100:00100000:2.0:1776191633.659696:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3352
00000100:00100000:1.0:1776191633.659707:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1690
00000100:00100000:1.0:1776191633.659712:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d6387b57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630951424:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191633.659723:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191633.659747:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d6387b57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630951424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (401us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191633.659753:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1690
00000100:00100000:1.0:1776191633.659775:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630951360
00000100:00100000:1.0:1776191633.659796:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630951296
00000100:00100000:1.0:1776191633.659818:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2114
00000100:00100000:1.0:1776191633.659822:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c5289760 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630951360:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191633.659849:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c5289760 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630951360:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (545us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191633.659854:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2114
00000100:00100000:1.0:1776191633.659864:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2115
00000100:00100000:1.0:1776191633.659867:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000083bd5abd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630951296:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191633.659895:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000083bd5abd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630951296:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (529us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191633.659900:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2115
00000100:00100000:1.0:1776191633.659941:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dab16da3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630951040:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191633.659981:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630951168
00000100:00100000:3.0:1776191633.659999:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191633.660021:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000000c87374 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630950912:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191633.660023:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630951680
00000100:00100000:1.0:1776191633.660071:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630951616
00000100:00100000:3.0:1776191633.660077:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191633.660093:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630950976
00000100:00100000:1.0:1776191633.660110:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4926
00000100:00100000:3.0:1776191633.660116:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1bce22f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630951488:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191633.660117:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a6e01f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630951168:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191633.660151:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191633.660163:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a6e01f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630951168:12345-0@lo:400:kworker/u8:4.0 Request processed in 46us (870us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191633.660170:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037d67e5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630951552:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191633.660171:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4926
00000100:00100000:1.0:1776191633.660190:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4927
00000100:00100000:1.0:1776191633.660194:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f365b48 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630951680:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191633.660201:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191633.660230:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f365b48 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630951680:12345-0@lo:400:kworker/u8:4.0 Request processed in 34us (805us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191633.660236:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4927
00000100:00100000:1.0:1776191633.660245:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4928
00000100:00100000:1.0:1776191633.660247:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004270d9b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630951616:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191633.660268:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004270d9b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630951616:12345-0@lo:400:kworker/u8:4.0 Request processed in 20us (810us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191633.660273:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4928
00000100:00100000:1.0:1776191633.660283:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4929
00000100:00100000:1.0:1776191633.660286:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3653833 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630950976:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191633.660319:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630951488
00000100:00100000:3.0:1776191633.660339:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630951552
00000100:00100000:3.0:1776191633.660353:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2446
00000100:00100000:3.0:1776191633.660356:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009af94ad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630951488:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191633.660450:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191633.660496:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009af94ad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630951488:12345-0@lo:8:kworker/u8:4.0 Request processed in 139us (346us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191633.660503:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2446
00000100:00100000:3.0:1776191633.660515:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2447
00000100:00100000:3.0:1776191633.660518:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004250bccf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630951552:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191633.660541:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3653833 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630950976:12345-0@lo:400:kworker/u8:4.0 Request processed in 253us (543us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191633.660549:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4929
00010000:02020000:3.0:1776191633.660606:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191633.660629:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004250bccf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630951552:12345-0@lo:8:kworker/u8:4.0 Request processed in 110us (433us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191633.660635:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2447
00000100:00100000:3.0:1776191633.660666:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630950912
00000100:00100000:3.0:1776191633.660691:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1840
00000100:00100000:3.0:1776191633.660694:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cdaa8581 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630950912:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191633.660720:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cdaa8581 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630950912:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (644us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191633.660725:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1840
00000100:00080000:3.0:1776191633.660756:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191633.660759:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191633.660763:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1bce22f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630951488:0@lo:8:kworker/u8:4.0
00000100:00080000:3.0:1776191633.660771:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191633.660773:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191633.660775:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037d67e5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630951552:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191633.660807:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064912ce2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630950976:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191633.660828:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000000c87374 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630950912:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191633.660868:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007a66bc0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630951296:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191633.660877:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004172df30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630951680:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191633.660887:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a9c33ce9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630951104:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191633.660896:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b3fa5790 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630951360:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191633.660932:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005f28ffee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630951232:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191633.660941:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000182c146b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630951616:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191633.660950:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f77bc1c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630951168:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191633.660961:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008bacde2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630951424:0@lo:13:osp-pre-0-0.0
00010000:00010000:3.0:1776191634.426466:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191635.290892:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191635.290938:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191635.290960:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613812480
00000100:00100000:2.0:1776191635.291017:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191635.291071:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1841
00000100:00100000:1.0:1776191635.291077:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009803db2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613812480:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191635.291134:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009803db2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613812480:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 57us (251us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191635.291139:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1841
00000100:00100000:0.0:1776191635.293249:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613812608
00000100:00100000:0.0:1776191635.293308:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613812544
00000100:00100000:0.0:1776191635.293331:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4930
00000100:00100000:0.0:1776191635.293336:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f6f66ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613812608:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191635.293343:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4931
00000100:00100000:1.0:1776191635.293349:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000045bf3481 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613812544:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191635.293393:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f6f66ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613812608:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 57us (2456us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191635.293399:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4930
00000100:00100000:2.0:1776191635.293471:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191635.293507:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191635.293539:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613812672
00000100:00100000:0.0:1776191635.293559:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613812736
00000100:00100000:2.0:1776191635.293575:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2116
00000100:00100000:2.0:1776191635.293580:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000015a1beae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613812672:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191635.293589:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2448
00000100:00100000:0.0:1776191635.293595:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ce899cfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613812736:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00000100:00100000:2.0:1776191635.293616:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000015a1beae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613812672:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 35us (145us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191635.293638:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2116
00010000:02020000:0.0:1776191635.293696:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191635.293724:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ce899cfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613812736:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 128us (217us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191635.293730:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2448
00000100:00100000:1.0:1776191635.293821:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000045bf3481 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613812544:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 470us (2804us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191635.293829:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4931
00010000:00010000:3.0:1776191635.450874:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191636.475562:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191636.731223:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d0e4254d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630951744:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191636.731312:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191636.731966:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630951744
00000100:00100000:1.0:1776191636.732108:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3353
00000100:00100000:1.0:1776191636.732117:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000007a840d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630951744:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191636.732157:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191636.732215:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000007a840d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630951744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (904us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191636.732223:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3353
00000100:00100000:2.0:1776191636.732268:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0e4254d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630951744:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191637.500059:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191637.758408:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630951808:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191637.758487:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191637.760526:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630951808
00000100:00100000:2.0:1776191637.760593:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3354
00000100:00100000:2.0:1776191637.760598:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000b9cbeaa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630951808:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191637.760631:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191637.761608:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000b9cbeaa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630951808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 995us (3108us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191637.761620:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3354
00000100:00100000:0.0:1776191637.761932:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630951808:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191638.523418:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191638.778876:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d72c3363 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630951872:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191638.778943:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191638.779524:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008bacde2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630951936:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191638.779556:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191638.779729:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630951872
00000100:00100000:0.0:1776191638.779777:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630951936
00000100:00100000:0.0:1776191638.779796:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1691
00000100:00100000:0.0:1776191638.779802:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d0e4254d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630951872:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191638.779831:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191638.779872:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d0e4254d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630951872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (930us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191638.779879:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1691
00000100:00100000:0.0:1776191638.779896:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1692
00000100:00100000:0.0:1776191638.779899:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004905ea34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630951936:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191638.779909:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191638.779932:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004905ea34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630951936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 32us (376us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191638.779938:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1692
00000100:00100000:3.0:1776191638.780195:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d72c3363 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630951872:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191638.781176:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008bacde2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630951936:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1776191638.783077:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191638.783084:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191638.783088:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191638.783094:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4171
00000100:00080000:1.0:1776191638.783099:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191638.783105:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191638.783123:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000035c1bc3b x1862467630952320/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191638.783139:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191638.783142:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191638.783143:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191638.783146:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4171
00000100:00080000:1.0:1776191638.783147:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191638.783150:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191638.783161:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000979c33e3 x1862467630952384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191638.783196:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000035c1bc3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630952320:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191638.783254:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191638.783277:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000979c33e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630952384:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191638.783298:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191638.783327:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae6c8b4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630952128:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191638.783349:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191638.783364:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004152e894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630952512:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191638.783385:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191638.783401:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:1.0:1776191638.783405:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dab16da3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630952064:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191638.783786:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630952320
00000100:00100000:2.0:1776191638.783821:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630952384
00000100:00100000:2.0:1776191638.783838:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2449
00000100:00100000:2.0:1776191638.783844:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ab614e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630952320:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191638.783912:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2450
00000100:00100000:0.0:1776191638.783917:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005cfbecd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630952384:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191638.784005:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:02020000:0.0:1776191638.784080:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191638.784092:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ab614e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630952320:12345-0@lo:8:kworker/u8:2.0 Request processed in 246us (837us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191638.784100:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2449
00000100:00100000:0.0:1776191638.784118:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005cfbecd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630952384:12345-0@lo:8:kworker/u8:2.0 Request processed in 198us (818us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191638.784126:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2450
00000100:00100000:2.0:1776191638.784137:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009065a894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630952192:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191638.784169:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191638.784196:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:2.0:1776191638.784201:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630952000:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191638.784225:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191638.784239:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a8f21cc1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630952256:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191638.784258:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191638.784338:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630952000
00000100:00100000:3.0:1776191638.784369:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1842
00000100:00100000:3.0:1776191638.784373:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000364ff3a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630952000:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191638.784428:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000364ff3a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630952000:12345-0@lo:400:kworker/u8:2.0 Request processed in 54us (203us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191638.784434:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1842
00000100:00100000:0.0:1776191638.784800:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630952512
00000100:00100000:0.0:1776191638.784831:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630952192
00000100:00100000:0.0:1776191638.784849:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4932
00000100:00100000:0.0:1776191638.784853:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036ed4568 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630952512:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191638.784891:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036ed4568 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630952512:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (1506us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191638.784898:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4932
00000100:00100000:0.0:1776191638.784910:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4933
00000100:00100000:0.0:1776191638.784913:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bb1be949 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630952192:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191638.784937:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bb1be949 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630952192:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (769us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191638.784943:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4933
00000100:00100000:0.0:1776191638.784968:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630952128
00000100:00100000:0.0:1776191638.784989:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630952256
00000100:00100000:0.0:1776191638.785000:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3355
00000100:00100000:0.0:1776191638.785004:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000999cc3c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630952128:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191638.785054:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000999cc3c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630952128:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (1682us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191638.785061:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3355
00000100:00100000:0.0:1776191638.785073:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3356
00000100:00100000:0.0:1776191638.785076:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e6698059 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630952256:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191638.785099:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e6698059 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630952256:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (841us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191638.785106:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3356
00000100:00100000:1.0:1776191638.785144:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1776191638.785150:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191638.785155:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191638.785160:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000035c1bc3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630952320:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191638.785166:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000083657c43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630952448:0@lo:400:kworker/u8:2.0
00000100:00080000:0.0:1776191638.785173:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191638.785177:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191638.785180:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000979c33e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630952384:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191638.785189:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191638.785214:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae6c8b4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630952128:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191638.785220:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630952064
00000100:00100000:1.0:1776191638.785227:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004152e894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630952512:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191638.785248:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630952448
00000100:00100000:1.0:1776191638.785261:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4934
00000100:00100000:1.0:1776191638.785267:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c6a5e12 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630952064:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191638.785274:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4935
00000100:00100000:1.0:1776191638.785297:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c6a5e12 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630952064:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (154us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191638.785823:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000053f60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630952448:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191638.785860:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000053f60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630952448:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (671us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191638.785920:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630952000:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191638.785935:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a8f21cc1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630952256:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191638.785943:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009065a894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630952192:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191638.787683:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dab16da3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630952064:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191638.787745:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4934
00000100:00100000:2.0:1776191638.787865:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000083657c43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630952448:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191638.794450:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4935
00010000:00010000:3.0:1776191639.546283:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191640.411448:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191640.411510:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191640.411592:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613812992
00000100:00100000:2.0:1776191640.411685:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191640.411715:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2117
00000100:00100000:1.0:1776191640.411726:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a6aa2ef8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613812992:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191640.411773:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613812864
00000100:00100000:1.0:1776191640.411838:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a6aa2ef8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613812992:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 111us (326us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191640.411846:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2117
00000100:00100000:2.0:1776191640.415461:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191640.415508:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191640.415562:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613812800
00000100:00100000:2.0:1776191640.415632:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1843
00000100:00100000:2.0:1776191640.415642:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ea43294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613812800:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191640.415747:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ea43294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613812800:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 106us (4187us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191640.415760:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1843
00000100:00100000:2.0:1776191640.415804:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613812928
00000100:00100000:0.0:1776191640.416051:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4936
00000100:00100000:0.0:1776191640.416061:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d5a6a4da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613812864:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191640.416115:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d5a6a4da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613812864:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 54us (4690us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191640.417791:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613813056
00000100:00100000:1.0:1776191640.417859:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2451
00000100:00100000:1.0:1776191640.417868:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000182c146b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613813056:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:1.0:1776191640.417983:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191640.418065:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000182c146b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613813056:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 197us (2556us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191640.418073:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2451
00000100:00100000:0.0:1776191640.419536:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4936
00000100:00100000:2.0:1776191640.419561:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4937
00000100:00100000:2.0:1776191640.419572:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f77bc1c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613812928:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191640.419699:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f77bc1c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613812928:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 128us (4245us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191640.419707:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4937
00010000:00010000:3.0:1776191640.571145:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191641.594996:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191641.852398:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191641.852420:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630952576:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191641.852497:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191641.852707:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630952576
00000100:00100000:3.0:1776191641.852789:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3357
00000100:00100000:3.0:1776191641.852795:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008bacde2f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630952576:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191641.852845:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191641.852901:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008bacde2f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630952576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (414us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191641.852908:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3357
00000100:00100000:0.0:1776191641.853097:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630952576:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191642.618535:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191642.875788:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776191642.875807:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004152e894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630952640:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191642.875878:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191642.875948:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630952640
00000100:00100000:0.0:1776191642.876146:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3358
00000100:00100000:0.0:1776191642.876152:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005f28ffee pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630952640:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191642.876187:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191642.876296:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005f28ffee pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630952640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (417us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191642.876308:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3358
00000100:00100000:1.0:1776191642.876380:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004152e894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630952640:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191643.642888:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1776191643.898429:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191643.898436:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191643.898439:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191643.898446:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4176
00000100:00080000:3.0:1776191643.898449:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191643.898455:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191643.898727:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a7098b67 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630952832:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191643.898792:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191643.898820:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006b57c159 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630953088:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191643.898985:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191643.899009:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:1.0:1776191643.899015:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007929ecd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630952896:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191643.899063:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191643.899080:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004152e894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630953152:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191643.899102:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191643.899134:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630952832
00000100:00100000:1.0:1776191643.899170:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3359
00000100:00100000:1.0:1776191643.899176:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d808a8bb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630952832:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191643.899225:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d808a8bb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630952832:12345-0@lo:400:kworker/u8:4.0 Request processed in 48us (434us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191643.899232:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3359
00000100:00100000:1.0:1776191643.899255:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630952896
00000100:00100000:1.0:1776191643.899277:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4938
00000100:00100000:1.0:1776191643.899281:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000bdc1af7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630952896:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191643.899307:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000bdc1af7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630952896:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (245us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191643.899312:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4938
00000100:00100000:1.0:1776191643.899329:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630953152
00000100:00100000:1.0:1776191643.899350:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1693
00000100:00100000:1.0:1776191643.899354:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a451ede3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630953152:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191643.899374:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191643.899399:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a451ede3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630953152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (297us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191643.899404:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1693
00000100:00100000:1.0:1776191643.899435:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007929ecd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630952896:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191643.899448:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004152e894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630953152:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191643.899456:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a7098b67 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630952832:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191643.899526:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630953088
00000100:00100000:1.0:1776191643.899548:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2118
00000100:00100000:1.0:1776191643.899551:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000033327a5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630953088:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191643.899754:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000080bc2d96 x1862467630953216/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191643.899769:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191643.899772:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191643.899774:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191643.899777:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4176
00000100:00080000:3.0:1776191643.899779:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191643.899782:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191643.899798:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000001fb0b50 x1862467630953280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191643.900020:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080bc2d96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630953216:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191643.900067:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191643.900082:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000001fb0b50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630953280:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191643.900102:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191643.900125:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191643.900132:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d72c3363 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630953472:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191643.900172:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191643.900200:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630953472
00000100:00100000:0.0:1776191643.900225:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1694
00000100:00100000:0.0:1776191643.900229:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000047404be6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630953472:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191643.900243:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191643.900272:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000047404be6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630953472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (100us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191643.900278:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1694
00000100:00100000:0.0:1776191643.900307:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d72c3363 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630953472:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191643.900340:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006b57c159 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630953088:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191643.900364:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630953216
00000100:00100000:0.0:1776191643.900381:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630953280
00000100:00100000:0.0:1776191643.900393:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2452
00000100:00100000:0.0:1776191643.900397:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000011eb3cbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630953216:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191643.900492:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191643.900528:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000011eb3cbb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630953216:12345-0@lo:8:kworker/u8:4.0 Request processed in 130us (461us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191643.900534:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2452
00000100:00100000:0.0:1776191643.900546:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2453
00000100:00100000:0.0:1776191643.900549:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000481c290f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630953280:12345-0@lo:8:kworker/u8:4.0
00000100:00080000:3.0:1776191643.900789:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191643.900794:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191643.900798:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080bc2d96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630953216:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191643.900973:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9d67e9c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630952768:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191643.901008:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191643.901054:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000b764083 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630953024:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191643.901077:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191643.901090:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ee7172c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630953408:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191643.901107:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191643.901123:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [2->3]
00000100:00100000:2.0:1776191643.901129:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630952704:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191643.901154:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191643.901166:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004c93f941 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630952960:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191643.901188:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191643.901202:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be4c283a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630953344:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191643.901220:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191643.901248:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630953024
00000100:00100000:2.0:1776191643.901272:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2119
00000100:00100000:2.0:1776191643.901275:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a9c33ce9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630953024:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191643.901309:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a9c33ce9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630953024:12345-0@lo:400:kworker/u8:4.0 Request processed in 33us (232us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191643.901315:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2119
00000100:00100000:2.0:1776191643.901337:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630952768
00000100:00100000:2.0:1776191643.901355:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630953408
00000100:00100000:2.0:1776191643.901368:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630953344
00000100:00100000:2.0:1776191643.901382:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4939
00000100:00100000:2.0:1776191643.901386:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b3fa5790 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630952768:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191643.901413:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b3fa5790 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630952768:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (405us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191643.901419:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4939
00000100:00100000:2.0:1776191643.901429:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4940
00000100:00100000:2.0:1776191643.901432:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004172df30 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630953408:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191643.901457:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004172df30 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630953408:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (349us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191643.901462:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4940
00000100:00100000:2.0:1776191643.901473:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4941
00000100:00100000:2.0:1776191643.901476:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000000c87374 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630953344:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191643.901499:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000000c87374 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630953344:12345-0@lo:400:kworker/u8:4.0 Request processed in 22us (279us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191643.901504:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4941
00000100:00100000:2.0:1776191643.901522:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630952960
00000100:00100000:2.0:1776191643.901541:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3360
00000100:00100000:2.0:1776191643.901545:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a66bc0f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630952960:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191643.901570:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a66bc0f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630952960:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (382us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191643.901575:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3360
00000100:00100000:3.0:1776191643.901964:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630952704
00000100:00100000:3.0:1776191643.901990:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1844
00000100:00100000:3.0:1776191643.901993:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d186bef1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630952704:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191643.902024:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d186bef1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630952704:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (870us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191643.902029:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1844
00000100:00100000:3.0:1776191643.902116:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a8e91aa5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630952704:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191643.902125:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004c93f941 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630952960:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191643.902134:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be4c283a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630953344:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191643.902141:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9d67e9c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630952768:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191643.902150:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000b764083 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630953024:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191643.902157:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ee7172c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630953408:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191643.904289:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000033327a5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630953088:12345-0@lo:400:kworker/u8:4.0 Request processed in 4728us (5296us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191643.904305:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2118
00010000:02020000:0.0:1776191643.904347:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191643.904411:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000481c290f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630953280:12345-0@lo:8:kworker/u8:4.0 Request processed in 3860us (4308us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191643.904419:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2453
00000100:00080000:3.0:1776191643.904550:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191643.904554:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191643.904560:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000001fb0b50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630953280:0@lo:8:kworker/u8:4.0
00010000:00010000:3.0:1776191644.670505:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191645.530588:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191645.530642:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191645.530679:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191645.530710:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191645.530752:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613813184
00000100:00100000:1.0:1776191645.530757:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613813248
00000100:00100000:0.0:1776191645.530827:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613813312
00000100:00100000:2.0:1776191645.530840:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613813120
00000100:00100000:0.0:1776191645.530869:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2120
00000100:00100000:2.0:1776191645.530874:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1845
00000100:00100000:0.0:1776191645.530878:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ee7172c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613813312:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191645.530881:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000050bd026a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613813120:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191645.531268:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000050bd026a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613813120:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 386us (687us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191645.531277:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1845
00000100:00100000:3.0:1776191645.531710:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4942
00000100:00100000:3.0:1776191645.531715:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000001fb0b50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613813184:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191645.534531:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4943
00000100:00100000:1.0:1776191645.534541:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000b764083 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613813248:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191645.535582:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ee7172c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613813312:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 4701us (4897us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191645.535596:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2120
00000100:00100000:0.0:1776191645.535697:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191645.535730:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613813376
00000100:00100000:0.0:1776191645.535760:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2454
00000100:00100000:0.0:1776191645.535765:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b4ee822 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613813376:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:0.0:1776191645.535857:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191645.535885:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b4ee822 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613813376:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 120us (190us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191645.535892:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2454
00000100:00100000:3.0:1776191645.542581:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000001fb0b50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613813184:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 10856us (11930us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191645.542598:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4942
00000100:00100000:1.0:1776191645.543496:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000b764083 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613813248:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 8951us (12781us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191645.543507:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4943
00010000:00010000:3.0:1776191645.690312:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191646.714471:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191646.970320:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9d67e9c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630953536:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191646.970398:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191646.970499:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630953536
00000100:00100000:2.0:1776191646.970561:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3361
00000100:00100000:2.0:1776191646.970567:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036033aa5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630953536:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191646.970603:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191646.981698:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036033aa5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630953536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 11121us (11292us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191646.981713:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3361
00000100:00100000:0.0:1776191646.982373:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9d67e9c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630953536:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191647.741307:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191647.994629:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1776191647.994644:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004152e894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630953600:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191647.994720:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191647.996553:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630953600
00000100:00100000:2.0:1776191647.996627:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3362
00000100:00100000:2.0:1776191647.996633:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be4c283a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630953600:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191647.996670:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191647.996736:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be4c283a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630953600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (2017us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191647.996743:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3362
00000100:00100000:2.0:1776191647.996783:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004152e894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630953600:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191648.762399:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191649.018383:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1776191649.018397:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093074f1e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630953664:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191649.018453:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191649.018462:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fb7e6216 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630953728:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191649.018463:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191649.018570:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630953664
00000100:00080000:3.0:1776191649.018595:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191649.018599:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191649.018602:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191649.018607:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4181
00000100:00080000:3.0:1776191649.018610:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191649.018614:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191649.018625:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1695
00000100:00100000:2.0:1776191649.018630:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096e89164 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630953664:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191649.018633:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000006b668658 x1862467630954176/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191649.018650:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191649.018653:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191649.018654:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191649.018656:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4181
00002000:00000024:2.0:1776191649.018657:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00080000:3.0:1776191649.018658:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191649.018660:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191649.018668:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000091107a98 x1862467630954240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191649.018695:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006b668658 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630954176:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191649.020884:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191649.020940:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004c93f941 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630953792:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191649.021259:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080bc2d96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630953856:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191649.021297:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191649.021314:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d10a82b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630954112:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191649.021413:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191649.021440:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:1.0:1776191649.021446:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004385f089 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630953920:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191649.021473:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191649.021503:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000181f7419 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630954304:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191649.021528:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191649.021570:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630953856
00000100:00100000:1.0:1776191649.021611:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630954304
00000100:00100000:1.0:1776191649.021631:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4944
00000100:00100000:1.0:1776191649.021636:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cab58035 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630953856:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191649.021684:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cab58035 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630953856:12345-0@lo:400:kworker/u8:4.0 Request processed in 47us (387us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191649.021691:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4944
00000100:00100000:1.0:1776191649.021708:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4945
00000100:00100000:1.0:1776191649.021712:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000024e1efe8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630954304:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191649.021736:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000024e1efe8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630954304:12345-0@lo:400:kworker/u8:4.0 Request processed in 24us (208us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191649.021742:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4945
00000100:00100000:1.0:1776191649.021762:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630953728
00000100:00100000:1.0:1776191649.021783:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1696
00000100:00100000:1.0:1776191649.021787:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000989821a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630953728:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191649.021801:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191649.021830:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000989821a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630953728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (953us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191649.021836:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1696
00000100:00100000:1.0:1776191649.021854:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630953920
00000100:00100000:1.0:1776191649.021879:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3363
00000100:00100000:1.0:1776191649.021883:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004253d689 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630953920:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191649.021912:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004253d689 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630953920:12345-0@lo:400:kworker/u8:4.0 Request processed in 29us (439us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191649.021918:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3363
00000100:00100000:1.0:1776191649.021951:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004385f089 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630953920:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191649.021962:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000181f7419 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630954304:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191649.021971:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080bc2d96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630953856:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191649.022573:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630954112
00000100:00100000:1.0:1776191649.022603:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2121
00000100:00100000:1.0:1776191649.022608:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003135b5de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630954112:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191649.022645:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003135b5de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630954112:12345-0@lo:400:kworker/u8:4.0 Request processed in 37us (1308us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191649.022651:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2121
00000100:00100000:1.0:1776191649.022684:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d10a82b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630954112:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191649.022724:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000081563597 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630953984:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191649.022749:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191649.022763:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000024a6daa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630954368:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191649.022781:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191649.022803:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630953984
00000100:00100000:1.0:1776191649.022821:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630954368
00000100:00100000:1.0:1776191649.022835:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4946
00000100:00100000:1.0:1776191649.022838:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000789f146e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630953984:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191649.022869:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000789f146e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630953984:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (121us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191649.022879:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4946
00000100:00100000:1.0:1776191649.022891:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4947
00000100:00100000:1.0:1776191649.022895:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006642ad22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630954368:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191649.022919:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006642ad22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630954368:12345-0@lo:400:kworker/u8:4.0 Request processed in 24us (137us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191649.022925:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4947
00000100:00100000:1.0:1776191649.022951:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000081563597 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630953984:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191649.022960:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000024a6daa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630954368:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191649.025464:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191649.025521:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005eac7f74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630954048:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191649.025555:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191649.026951:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630953792
00000100:00100000:1.0:1776191649.027017:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1846
00000100:00100000:1.0:1776191649.027023:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008cbd400d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630953792:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191649.027124:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008cbd400d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630953792:12345-0@lo:400:kworker/u8:4.0 Request processed in 86us (1652us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191649.027132:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1846
00000100:00100000:1.0:1776191649.027188:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630954048
00000100:00100000:1.0:1776191649.027212:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3364
00000100:00100000:1.0:1776191649.027216:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa646f87 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630954048:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191649.027248:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa646f87 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630954048:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (1693us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191649.027253:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fb7e6216 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630953728:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191649.027254:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3364
00000100:00100000:0.0:1776191649.027412:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004c93f941 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630953792:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191649.027424:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005eac7f74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630954048:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191649.027535:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096e89164 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630953664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 8902us (9071us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191649.027543:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1695
00000100:00100000:1.0:1776191649.032617:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093074f1e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630953664:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191649.033246:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191649.033280:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000091107a98 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630954240:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191649.033316:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191649.033509:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630954176
00000100:00100000:1.0:1776191649.033550:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630954240
00000100:00100000:1.0:1776191649.033569:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2455
00000100:00100000:1.0:1776191649.033574:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e1a1a8ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630954176:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191649.033676:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191649.033717:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e1a1a8ea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630954176:12345-0@lo:8:kworker/u8:4.0 Request processed in 142us (473us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191649.033725:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2455
00000100:00100000:1.0:1776191649.033741:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2456
00000100:00100000:1.0:1776191649.033744:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a1b8127c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630954240:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191649.033834:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191649.033858:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a1b8127c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630954240:12345-0@lo:8:kworker/u8:4.0 Request processed in 112us (542us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191649.033864:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2456
00000100:00080000:3.0:1776191649.034530:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191649.034537:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191649.034541:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006b668658 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630954176:0@lo:8:kworker/u8:4.0
00000100:00080000:3.0:1776191649.034552:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191649.034555:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191649.034558:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000091107a98 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630954240:0@lo:8:kworker/u8:4.0
00010000:00010000:0.0:1776191649.788429:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191650.656958:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191650.657007:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191650.657093:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191650.657115:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191650.657141:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191650.657166:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613813632
00000100:00100000:0.0:1776191650.657167:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613813568
00000100:00100000:0.0:1776191650.657206:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613813504
00000100:00100000:2.0:1776191650.657206:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613813696
00000100:00100000:0.0:1776191650.657222:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4948
00000100:00100000:2.0:1776191650.657222:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2122
00000100:00100000:0.0:1776191650.657228:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000064912ce2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613813568:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191650.657228:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1bce22f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613813632:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191650.657309:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613813440
00000100:00100000:3.0:1776191650.657318:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2457
00000100:00100000:3.0:1776191650.657322:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dab16da3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613813696:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00000100:00100000:1.0:1776191650.657335:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1847
00000100:00100000:1.0:1776191650.657339:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000afc79a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613813440:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191650.657390:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000064912ce2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613813568:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 161us (384us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191650.657398:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4948
00000100:00100000:0.0:1776191650.657414:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4949
00010000:02020000:3.0:1776191650.657417:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191650.657418:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000037d67e5b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613813504:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191650.657461:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000037d67e5b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613813504:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 41us (368us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191650.657461:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1bce22f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613813632:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 232us (345us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191650.657468:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4949
00000100:00100000:2.0:1776191650.657468:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2122
00000100:00100000:1.0:1776191650.664947:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000afc79a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613813440:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 7599us (7988us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191650.664964:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1847
00000100:00100000:3.0:1776191650.669113:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dab16da3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613813696:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 11780us (11962us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191650.669131:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2457
00010000:00010000:3.0:1776191650.814725:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191651.834293:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191652.090857:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191652.090876:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000091107a98 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630954432:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191652.090994:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191652.091163:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630954432
00000100:00100000:0.0:1776191652.091211:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3365
00000100:00100000:0.0:1776191652.091217:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c499a21 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630954432:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191652.091266:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191652.091324:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c499a21 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630954432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (331us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191652.091331:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3365
00000100:00100000:2.0:1776191652.091436:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000091107a98 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630954432:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191652.858273:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191653.114474:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008a5f141d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630954496:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191653.114563:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191653.114792:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630954496
00000100:00100000:0.0:1776191653.114838:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3366
00000100:00100000:0.0:1776191653.114844:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000cddb455 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630954496:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191653.114876:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191653.114930:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000cddb455 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630954496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (368us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191653.114937:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3366
00000100:00100000:3.0:1776191653.115029:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008a5f141d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630954496:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191653.883853:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191654.138215:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1776191654.138231:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006b668658 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630954560:0@lo:400:kworker/u8:2.0
00000100:00080000:3.0:1776191654.138282:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191654.138288:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191654.138292:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191654.138299:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4187
00000100:00080000:3.0:1776191654.138302:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00100000:2.0:1776191654.138307:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1776191654.138309:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191654.138331:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000604d562e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630954816:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191654.138339:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000091107a98 x1862467630955136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191654.138346:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fb7e6216 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630954752:0@lo:13:osp-pre-0-0.0
00000100:00080000:3.0:1776191654.138360:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191654.138364:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191654.138366:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1776191654.138394:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191654.138395:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630954560
00000100:00100000:0.0:1776191654.138401:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191654.138416:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f04c7a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630955008:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191654.138429:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cea0d9c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630955072:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1776191654.138447:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4187
00000100:00080000:3.0:1776191654.138450:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00100000:1.0:1776191654.138453:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1848
00000100:00080000:3.0:1776191654.138456:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191654.138467:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003026b1b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630954560:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191654.138473:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191654.138475:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000005eac7f74 x1862467630955200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191654.138520:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003026b1b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630954560:12345-0@lo:400:kworker/u8:2.0 Request processed in 57us (215us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191654.138522:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bf1af312 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630954688:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191654.138534:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1848
00000100:00100000:0.0:1776191654.138539:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5f2099 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630954624:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191654.138575:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191654.138575:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630954752
00000100:00100000:3.0:1776191654.138581:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191654.138598:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009d80d649 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630954880:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191654.138605:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630955072
00000100:00100000:3.0:1776191654.138609:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec6658fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630954944:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191654.138627:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1697
00000100:00100000:1.0:1776191654.138637:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c0e1db0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630954752:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191654.138638:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191654.138646:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191654.138659:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004c93f941 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630955264:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191654.138669:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000024a6daa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630955328:0@lo:400:kworker/u8:2.0
00002000:00000024:1.0:1776191654.138676:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191654.138697:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191654.139208:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191654.139246:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000091107a98 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630955136:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191654.139291:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191654.139294:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191654.139323:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006b668658 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630954560:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191654.139327:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005eac7f74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630955200:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191654.139364:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630954816
00000100:00100000:2.0:1776191654.139407:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630954624
00000100:00100000:2.0:1776191654.139442:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630955264
00000100:00100000:3.0:1776191654.139446:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191654.139466:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630955328
00000100:00100000:2.0:1776191654.139484:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4950
00000100:00100000:3.0:1776191654.139487:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630954944
00000100:00100000:2.0:1776191654.139490:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001db836ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630954816:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191654.139518:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630955008
00000100:00100000:2.0:1776191654.139538:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001db836ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630954816:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (1139us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191654.139539:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630955136
00000100:00100000:2.0:1776191654.139547:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4950
00000100:00100000:3.0:1776191654.139552:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630955200
00000100:00100000:2.0:1776191654.139567:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4951
00000100:00100000:3.0:1776191654.139570:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2123
00000100:00100000:2.0:1776191654.139574:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000011d3c5e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630954624:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191654.139579:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d10a82b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630954944:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191654.139603:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000011d3c5e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630954624:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (1028us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191654.139609:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4951
00000100:00100000:2.0:1776191654.139622:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4952
00000100:00100000:2.0:1776191654.139626:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc7ab3d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630955264:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191654.139635:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d10a82b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630954944:12345-0@lo:400:kworker/u8:2.0 Request processed in 57us (989us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191654.139642:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2123
00000100:00100000:2.0:1776191654.139660:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc7ab3d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630955264:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (963us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191654.139661:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2124
00000100:00100000:3.0:1776191654.139669:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003e720e58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3365:x1862467630955008:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191654.139671:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4952
00000100:00100000:2.0:1776191654.139689:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4953
00000100:00100000:2.0:1776191654.139694:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000080bc2d96 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630955328:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191654.139709:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003e720e58 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3365:x1862467630955008:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (423us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191654.139716:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2124
00000100:00100000:2.0:1776191654.139728:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000080bc2d96 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630955328:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (520us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191654.139735:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4953
00000100:00100000:2.0:1776191654.139767:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2458
00000100:00100000:2.0:1776191654.139771:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000181f7419 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630955136:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191654.139883:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2459
00000100:00100000:3.0:1776191654.139887:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004385f089 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630955200:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191654.139972:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191654.140010:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004385f089 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630955200:12345-0@lo:8:kworker/u8:2.0 Request processed in 122us (566us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191654.140016:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2459
00000100:00100000:3.0:1776191654.140071:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630954688
00000100:00100000:3.0:1776191654.140107:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630954880
00000100:00100000:3.0:1776191654.140119:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3367
00000100:00100000:3.0:1776191654.140122:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081563597 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630954688:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191654.140151:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081563597 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630954688:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (1574us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191654.140157:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3367
00000100:00100000:3.0:1776191654.140168:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3368
00000100:00100000:3.0:1776191654.140172:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a27cd066 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630954880:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191654.140196:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a27cd066 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630954880:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (1569us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191654.140201:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3368
00000100:00080000:3.0:1776191654.140231:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191654.140234:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191654.140238:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005eac7f74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630955200:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191654.140266:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bf1af312 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630954688:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191654.140276:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec6658fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630954944:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191654.140285:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000024a6daa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630955328:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191654.140313:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f04c7a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630955008:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191654.140357:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1698
00000100:00100000:3.0:1776191654.140361:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d7848e1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630955072:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191654.140387:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191654.140415:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d7848e1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630955072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (1960us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191654.140422:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1698
00000100:00100000:3.0:1776191654.140516:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000604d562e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630954816:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191654.140531:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cea0d9c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630955072:0@lo:13:osp-pre-0-1.0
00010000:02020000:2.0:1776191654.141401:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191654.141465:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000181f7419 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630955136:12345-0@lo:8:kworker/u8:2.0 Request processed in 1693us (2178us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191654.141475:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2458
00000100:00080000:3.0:1776191654.144241:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191654.144254:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191654.144263:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000091107a98 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630955136:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191654.146147:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c0e1db0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630954752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7506us (7747us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191654.146161:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1697
00000100:00100000:3.0:1776191654.146247:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fb7e6216 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630954752:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191654.148608:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004c93f941 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630955264:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191654.148653:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5f2099 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630954624:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191654.148665:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009d80d649 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630954880:0@lo:400:kworker/u8:2.0
00010000:00010000:3.0:1776191654.907449:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191655.771602:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191655.771647:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191655.771695:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191655.771731:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191655.771754:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613813952
00000100:00100000:1.0:1776191655.771817:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2125
00000100:00100000:1.0:1776191655.771824:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000118a85b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613813952:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191655.771894:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000118a85b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613813952:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 69us (246us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191655.771901:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2125
00000100:00100000:0.0:1776191655.772084:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613813824
00000100:00100000:0.0:1776191655.772122:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613813888
00000100:00100000:0.0:1776191655.772141:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4954
00000100:00100000:0.0:1776191655.772145:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000929f088f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613813824:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191655.772180:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000929f088f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613813824:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 35us (587us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191655.772187:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4954
00000100:00100000:0.0:1776191655.772199:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4955
00000100:00100000:0.0:1776191655.772204:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e485b2c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613813888:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191655.772225:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e485b2c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613813888:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 22us (495us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191655.772232:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4955
00000100:00100000:0.0:1776191655.772266:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191655.772368:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613813760
00000100:00100000:0.0:1776191655.772398:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1849
00000100:00100000:0.0:1776191655.772404:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be2451ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613813760:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191655.772443:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be2451ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613813760:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 39us (759us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191655.772448:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1849
00000100:00100000:3.0:1776191655.772614:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613814016
00000100:00100000:3.0:1776191655.772655:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2460
00000100:00100000:3.0:1776191655.772659:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000059e49ec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613814016:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:3.0:1776191655.772759:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191655.772791:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000059e49ec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613814016:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 131us (525us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191655.772798:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2460
00010000:00010000:0.0:1776191655.930630:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191656.958549:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191657.211382:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000091107a98 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630955392:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191657.211454:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191657.211539:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630955392
00000100:00100000:3.0:1776191657.211581:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3369
00000100:00100000:3.0:1776191657.211587:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d1ba4a82 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630955392:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191657.211617:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191657.211676:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d1ba4a82 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630955392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (223us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191657.211684:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3369
00000100:00100000:2.0:1776191657.211872:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000091107a98 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630955392:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191657.978225:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191658.234830:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1776191658.234844:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bedc80a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630955456:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191658.234907:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191658.235058:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630955456
00000100:00100000:3.0:1776191658.235108:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3370
00000100:00100000:3.0:1776191658.235114:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004790ea41 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630955456:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191658.235147:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191658.235196:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004790ea41 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630955456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (290us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191658.235203:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3370
00000100:00100000:2.0:1776191658.235595:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bedc80a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630955456:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191659.002196:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191659.258255:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191659.258290:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000604d562e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630955520:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191659.258358:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191659.258402:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630955520
00000100:00100000:3.0:1776191659.258461:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1699
00000100:00100000:3.0:1776191659.258468:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000f04c7a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630955520:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191659.258498:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191659.258536:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000f04c7a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630955520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (178us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191659.258543:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1699
00000100:00100000:3.0:1776191659.258586:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000604d562e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630955520:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191659.259467:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776191659.259482:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000abb7dbe9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630955584:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191659.259522:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191659.259634:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191659.259640:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191659.259642:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191659.259647:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4192
00000100:00080000:1.0:1776191659.259649:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191659.259654:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191659.259671:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000003135b5de x1862467630955968/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191659.259683:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191659.259686:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191659.259688:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191659.259690:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4192
00000100:00080000:1.0:1776191659.259691:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191659.259694:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191659.259702:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000008a5f141d x1862467630956032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191659.262901:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f947cdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630955648:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191659.262930:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bedc80a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630955712:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191659.263051:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003135b5de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630955968:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191659.263287:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ab614e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630955776:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191659.270953:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191659.271013:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000033327a5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630955904:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191659.272302:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630955648
00000100:00100000:3.0:1776191659.272367:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1850
00000100:00100000:3.0:1776191659.272373:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f9c8ab18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630955648:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191659.273556:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191659.273611:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004152e894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630956096:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191659.273658:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191659.277084:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191659.277148:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000083657c43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630956160:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191659.277220:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630955776
00000100:00100000:1.0:1776191659.277278:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3371
00000100:00100000:1.0:1776191659.277284:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a8f21cc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630955776:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191659.277340:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a8f21cc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630955776:12345-0@lo:400:kworker/u8:4.0 Request processed in 55us (263us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191659.277347:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3371
00000100:00100000:2.0:1776191659.277483:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630955712
00000100:00100000:2.0:1776191659.277514:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630956096
00000100:00100000:2.0:1776191659.277533:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4956
00000100:00100000:2.0:1776191659.277538:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f5324e9b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630955712:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191659.277577:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f5324e9b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630955712:12345-0@lo:400:kworker/u8:4.0 Request processed in 38us (4026us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191659.277584:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4956
00000100:00100000:2.0:1776191659.277596:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4957
00000100:00100000:2.0:1776191659.277599:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000d245b4b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630956096:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191659.277630:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000d245b4b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630956096:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (3972us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191659.277635:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4957
00000100:00100000:2.0:1776191659.277679:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bedc80a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630955712:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191659.277690:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004152e894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630956096:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191659.277808:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630955584
00000100:00100000:2.0:1776191659.277835:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1700
00000100:00100000:2.0:1776191659.277840:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a1a9e6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630955584:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191659.277855:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191659.277887:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a1a9e6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630955584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (18365us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191659.277893:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1700
00000100:00100000:2.0:1776191659.278219:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005cfbecd5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630955840:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191659.278252:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191659.278302:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630955840
00000100:00100000:2.0:1776191659.278325:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4958
00000100:00100000:2.0:1776191659.278329:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f6c68e5e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630955840:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191659.278363:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f6c68e5e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630955840:12345-0@lo:400:kworker/u8:4.0 Request processed in 33us (111us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191659.278369:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4958
00000100:00100000:2.0:1776191659.278396:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005cfbecd5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630955840:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191659.278430:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191659.278449:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008a5f141d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630956032:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191659.278473:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191659.278513:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630955968
00000100:00100000:2.0:1776191659.278532:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630956032
00000100:00100000:2.0:1776191659.278545:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2461
00000100:00100000:2.0:1776191659.278548:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000baf461a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630955968:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191659.278644:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191659.278760:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2462
00000100:00100000:1.0:1776191659.278766:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e24a0555 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630956032:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191659.278782:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000baf461a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630955968:12345-0@lo:8:kworker/u8:4.0 Request processed in 231us (351us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191659.278790:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2461
00000100:00080000:2.0:1776191659.278818:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191659.278822:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191659.278826:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003135b5de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630955968:0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191659.278846:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191659.278882:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e24a0555 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630956032:12345-0@lo:8:kworker/u8:4.0 Request processed in 114us (408us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191659.278888:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2462
00000100:00080000:2.0:1776191659.278906:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1776191659.278913:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191659.278951:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000abb7dbe9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630955584:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191659.278994:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ab614e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630955776:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191659.279014:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630956160
00000100:00100000:1.0:1776191659.279050:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4959
00000100:00100000:1.0:1776191659.279053:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000979c33e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630956160:12345-0@lo:400:kworker/u8:4.0
00000100:00080000:2.0:1776191659.279082:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191659.279090:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000979c33e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630956160:12345-0@lo:400:kworker/u8:4.0 Request processed in 34us (177us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191659.279090:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008a5f141d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630956032:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191659.279100:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4959
00000100:00100000:1.0:1776191659.279141:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000083657c43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630956160:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191659.281424:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f9c8ab18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630955648:12345-0@lo:400:kworker/u8:4.0 Request processed in 9042us (10471us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191659.281439:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1850
00000100:00100000:0.0:1776191659.281609:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191659.281662:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f947cdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630955648:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191659.281729:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630955904
00000100:00100000:1.0:1776191659.281781:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3372
00000100:00100000:1.0:1776191659.281851:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008074d522 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630955904:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191659.281913:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008074d522 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630955904:12345-0@lo:400:kworker/u8:4.0 Request processed in 63us (305us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191659.282226:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3372
00000100:00100000:0.0:1776191659.282235:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000033327a5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630955904:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191660.026668:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191660.891182:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191660.891242:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191660.891281:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191660.891490:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613814272
00000100:00100000:1.0:1776191660.891545:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2126
00000100:00100000:1.0:1776191660.891553:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9d5bfab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613814272:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191660.891624:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9d5bfab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613814272:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 70us (382us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191660.891632:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2126
00000100:00100000:0.0:1776191660.895329:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191660.895557:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613814144
00000100:00100000:2.0:1776191660.895741:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613814208
00000100:00100000:2.0:1776191660.895766:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4960
00000100:00100000:2.0:1776191660.895773:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000615cbccf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613814144:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191660.895820:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191660.895846:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000615cbccf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613814144:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 72us (4670us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191660.895855:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4960
00000100:00100000:2.0:1776191660.895873:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4961
00000100:00100000:2.0:1776191660.895877:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ea5b1fb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613814208:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191660.895905:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ea5b1fb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613814208:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 27us (583us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191660.895912:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4961
00000100:00100000:3.0:1776191660.897101:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613814336
00000100:00100000:3.0:1776191660.897150:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2463
00000100:00100000:3.0:1776191660.897156:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000079aa8992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613814336:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:3.0:1776191660.897261:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191660.898098:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613814080
00000100:00100000:1.0:1776191660.898145:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1851
00000100:00100000:1.0:1776191660.898151:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081b9520e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613814080:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191660.898209:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081b9520e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613814080:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 57us (6928us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191660.898235:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1851
00000100:00100000:3.0:1776191660.898817:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000079aa8992 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613814336:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 1659us (2997us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191660.898826:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2463
00010000:00010000:3.0:1776191661.051653:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191662.074293:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191662.330248:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000604d562e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630956224:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191662.330328:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191662.330617:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630956224
00000100:00100000:3.0:1776191662.330667:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3373
00000100:00100000:3.0:1776191662.330673:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003ac7e5e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630956224:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191662.330703:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191662.330800:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003ac7e5e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630956224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (473us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191662.330808:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3373
00000100:00100000:2.0:1776191662.340407:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000604d562e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630956224:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191663.098342:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191663.354377:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1776191663.358850:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000083657c43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630956288:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191663.359073:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191663.365937:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630956288
00000100:00100000:1.0:1776191663.366152:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3374
00000100:00100000:1.0:1776191663.366158:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003c7a8ed3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630956288:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191663.366204:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191663.366306:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003c7a8ed3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630956288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (7235us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191663.366313:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3374
00000100:00100000:2.0:1776191663.366410:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000083657c43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630956288:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191664.130664:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191664.378457:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000024a6daa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630956352:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191664.378545:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191664.378636:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ab614e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630956416:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191664.378723:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191664.378764:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630956416
00000100:00100000:1.0:1776191664.378812:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1701
00000100:00100000:1.0:1776191664.378818:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000035c1bc3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630956416:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191664.378850:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191664.378889:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000035c1bc3b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630956416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (166us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191664.378895:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1701
00000100:00100000:1.0:1776191664.378943:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ab614e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630956416:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191664.378984:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630956352
00000100:00100000:1.0:1776191664.379007:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1852
00000100:00100000:1.0:1776191664.379011:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b0b64a4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630956352:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191664.379512:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000010d41dfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630956608:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191664.379544:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191664.379548:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bf1af312 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630956544:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191664.379580:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191664.379613:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630956544
00000100:00100000:0.0:1776191664.379692:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3375
00000100:00100000:0.0:1776191664.379697:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000053bdf8f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630956544:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191664.379733:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000053bdf8f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630956544:12345-0@lo:400:kworker/u8:4.0 Request processed in 36us (154us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191664.379739:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3375
00000100:00100000:0.0:1776191664.379770:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bf1af312 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630956544:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191664.379825:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630956608
00000100:00100000:0.0:1776191664.379849:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1702
00000100:00100000:0.0:1776191664.379852:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c28f8aad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630956608:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191664.379862:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191664.379887:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c28f8aad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630956608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (343us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191664.379892:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1702
00000100:00100000:0.0:1776191664.379924:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec6658fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630956480:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191664.379953:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191664.379988:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630956480
00000100:00100000:0.0:1776191664.380008:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4962
00000100:00100000:0.0:1776191664.380011:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000abb7dbe9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630956480:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191664.380051:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000abb7dbe9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630956480:12345-0@lo:400:kworker/u8:4.0 Request processed in 39us (98us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191664.380057:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4962
00000100:00100000:0.0:1776191664.380080:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec6658fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630956480:0@lo:400:kworker/u8:4.0
00000100:00080000:3.0:1776191664.383689:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191664.383696:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191664.383700:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191664.383708:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4197
00000100:00080000:3.0:1776191664.383712:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191664.383717:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191664.383736:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000e1a1a8ea x1862467630956800/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191664.383758:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191664.383761:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191664.383762:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191664.383765:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4197
00000100:00080000:3.0:1776191664.383767:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191664.383770:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191664.383793:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000a1b8127c x1862467630956864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191664.383863:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e1a1a8ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630956800:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191664.383925:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191664.383965:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630956800
00000100:00100000:3.0:1776191664.384002:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2464
00000100:00100000:3.0:1776191664.384008:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b57c159 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630956800:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191664.384124:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191664.384176:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b57c159 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630956800:12345-0@lo:8:kworker/u8:4.0 Request processed in 168us (251us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191664.384184:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2464
00000100:00100000:3.0:1776191664.384205:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1b8127c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630956864:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191664.384228:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191664.384251:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630956864
00000100:00100000:3.0:1776191664.384267:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2465
00000100:00100000:3.0:1776191664.384270:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7098b67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630956864:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191664.384347:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191664.384370:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7098b67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630956864:12345-0@lo:8:kworker/u8:4.0 Request processed in 99us (142us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191664.384375:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2465
00000100:00080000:3.0:1776191664.384403:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191664.384406:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191664.384410:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e1a1a8ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630956800:0@lo:8:kworker/u8:4.0
00000100:00080000:3.0:1776191664.384417:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191664.384419:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191664.384421:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1b8127c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630956864:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191664.386703:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b0b64a4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630956352:12345-0@lo:400:kworker/u8:4.0 Request processed in 7684us (8152us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191664.386718:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1852
00000100:00100000:2.0:1776191664.386910:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000024a6daa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630956352:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191664.386942:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9d67e9c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630956992:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191664.386989:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191664.387127:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000010d41dfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630956608:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191664.387142:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1776191664.387157:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d10a82b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630956928:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191664.387181:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191664.387254:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ee7172c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630956736:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191664.387287:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191664.387309:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191664.387314:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005eac7f74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630956672:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191664.387346:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630956736
00000100:00100000:0.0:1776191664.387389:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3376
00000100:00100000:0.0:1776191664.387395:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb7e6216 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630956736:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191664.387443:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb7e6216 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630956736:12345-0@lo:400:kworker/u8:4.0 Request processed in 48us (156us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191664.387449:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3376
00000100:00100000:3.0:1776191664.387771:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630956992
00000100:00100000:3.0:1776191664.387816:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4963
00000100:00100000:3.0:1776191664.387820:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000839a85c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630956992:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191664.387854:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630956928
00000100:00100000:1.0:1776191664.387857:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191664.387887:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630956672
00000100:00100000:1.0:1776191664.387892:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ee7172c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630956736:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191664.387913:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4964
00000100:00100000:0.0:1776191664.387919:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009dfc4098 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630956928:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191664.387924:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4965
00000100:00100000:1.0:1776191664.387930:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ab614e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630956672:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191664.387958:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009dfc4098 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630956928:12345-0@lo:400:kworker/u8:4.0 Request processed in 39us (776us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191664.387965:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4964
00000100:00100000:1.0:1776191664.387981:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ab614e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630956672:12345-0@lo:400:kworker/u8:4.0 Request processed in 49us (123us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191664.387989:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4965
00000100:00100000:0.0:1776191664.388014:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005eac7f74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630956672:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191664.388424:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d10a82b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630956928:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191664.388706:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000839a85c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630956992:12345-0@lo:400:kworker/u8:4.0 Request processed in 883us (1716us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191664.388713:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4963
00000100:00100000:2.0:1776191664.388759:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9d67e9c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630956992:0@lo:400:kworker/u8:4.0
00010000:00010000:0.0:1776191665.159238:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191666.016441:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191666.016489:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191666.016523:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191666.016617:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613814528
00000100:00100000:0.0:1776191666.016672:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4966
00000100:00100000:0.0:1776191666.016679:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003fdaece5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613814528:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191666.016753:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003fdaece5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613814528:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 73us (229us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191666.016761:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4966
00000100:00100000:3.0:1776191666.017121:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613814656
00000100:00100000:3.0:1776191666.017159:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2466
00000100:00100000:3.0:1776191666.017164:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ca8a173d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613814656:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:3.0:1776191666.017258:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191666.017304:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ca8a173d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613814656:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 139us (871us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191666.017310:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2466
00000100:00100000:1.0:1776191666.017616:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613814400
00000100:00100000:1.0:1776191666.017654:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1853
00000100:00100000:1.0:1776191666.017659:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085b2d193 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613814400:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191666.017701:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085b2d193 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613814400:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 41us (1213us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191666.017708:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1853
00000100:00100000:0.0:1776191666.020509:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191666.020556:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191666.020732:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613814464
00000100:00100000:2.0:1776191666.020785:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4967
00000100:00100000:2.0:1776191666.020791:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cea0d9c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613814464:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191666.020873:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cea0d9c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613814464:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 81us (373us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191666.020881:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4967
00000100:00100000:3.0:1776191666.022853:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613814592
00000100:00100000:3.0:1776191666.022910:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2127
00000100:00100000:3.0:1776191666.022916:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b4ee822 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613814592:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191666.022992:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b4ee822 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613814592:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 75us (2435us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191666.023000:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2127
00010000:00010000:3.0:1776191666.171950:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191667.194326:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191667.450369:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191667.450391:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1b8127c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630957056:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191667.450465:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191667.450622:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630957056
00000100:00100000:2.0:1776191667.450675:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3377
00000100:00100000:2.0:1776191667.450681:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dfe66647 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630957056:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191667.450720:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191667.450770:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dfe66647 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630957056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (305us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191667.450777:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3377
00000100:00100000:3.0:1776191667.451399:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1b8127c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630957056:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191668.218404:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191668.475122:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000999cc3c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630957120:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191668.475205:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191668.475454:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630957120
00000100:00100000:1.0:1776191668.475506:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3378
00000100:00100000:1.0:1776191668.475512:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a1b8127c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630957120:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191668.475546:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191668.475605:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a1b8127c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630957120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (401us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191668.475612:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3378
00000100:00100000:3.0:1776191668.475849:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000999cc3c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630957120:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191669.242360:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1776191669.498292:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191669.498299:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191669.498302:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191669.498310:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4202
00000100:00080000:3.0:1776191669.498313:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191669.498319:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191669.498339:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000005ee7172c x1862467630957632/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191669.498354:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191669.498356:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191669.498358:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191669.498361:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4202
00000100:00080000:3.0:1776191669.498364:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191669.498367:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191669.498376:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000024a6daa9 x1862467630957696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191669.498417:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000081563597 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630957376:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191669.498482:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191669.498694:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec6658fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630957760:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191669.498723:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191669.498746:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:3.0:1776191669.498751:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be4c283a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630957312:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191669.498775:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191669.498788:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005eac7f74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630957568:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191669.498811:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191669.498835:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ee7172c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630957632:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191669.498856:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191669.498870:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000024a6daa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630957696:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191669.498887:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191669.498919:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630957376
00000100:00100000:3.0:1776191669.498957:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630957760
00000100:00100000:3.0:1776191669.498978:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4968
00000100:00100000:3.0:1776191669.498984:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000604d562e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630957376:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191669.499232:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000604d562e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630957376:12345-0@lo:400:kworker/u8:2.0 Request processed in 247us (749us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191669.499240:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4968
00000100:00100000:3.0:1776191669.499263:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4969
00000100:00100000:3.0:1776191669.499268:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000091107a98 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630957760:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191669.499269:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630957312
00000100:00100000:0.0:1776191669.499305:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3379
00000100:00100000:3.0:1776191669.499310:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000091107a98 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630957760:12345-0@lo:400:kworker/u8:2.0 Request processed in 41us (585us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191669.499312:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d80d649 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630957312:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191669.499325:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4969
00000100:00100000:3.0:1776191669.499349:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630957568
00000100:00100000:0.0:1776191669.499359:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d80d649 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630957312:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (583us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191669.499365:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3379
00000100:00100000:3.0:1776191669.499374:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630957632
00000100:00100000:3.0:1776191669.499392:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630957696
00000100:00100000:0.0:1776191669.499398:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007929ecd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630957248:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191669.499410:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2128
00000100:00100000:3.0:1776191669.499416:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5f2099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630957568:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191669.499425:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191669.499453:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630957248
00000100:00100000:3.0:1776191669.499456:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5f2099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630957568:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (644us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191669.499464:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2128
00000100:00100000:3.0:1776191669.499480:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2467
00000100:00100000:0.0:1776191669.499483:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4970
00000100:00100000:3.0:1776191669.499487:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c93f941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630957632:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191669.499492:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093074f1e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630957248:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191669.499523:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093074f1e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630957248:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (100us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191669.499529:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4970
00000100:00100000:0.0:1776191669.499547:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d10a82b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630957504:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191669.499568:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191669.499598:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007929ecd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630957248:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191669.499611:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [2->3]
00000100:00100000:0.0:1776191669.499618:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e1a1a8ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630957184:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191669.499640:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191669.499653:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9d67e9c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630957440:0@lo:400:kworker/u8:2.0
00010000:02020000:3.0:1776191669.499670:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191669.499675:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191669.499696:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630957440
00000100:00100000:3.0:1776191669.499714:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c93f941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630957632:12345-0@lo:8:kworker/u8:2.0 Request processed in 229us (857us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191669.499722:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3380
00000100:00100000:3.0:1776191669.499725:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2467
00000100:00100000:0.0:1776191669.499731:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa646f87 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630957440:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191669.499741:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630957504
00000100:00100000:3.0:1776191669.499759:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2129
00000100:00100000:3.0:1776191669.499764:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036033aa5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630957504:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191669.499773:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa646f87 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630957440:12345-0@lo:400:kworker/u8:2.0 Request processed in 42us (97us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191669.499781:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3380
00000100:00100000:3.0:1776191669.499801:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036033aa5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630957504:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (231us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191669.499805:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bf1af312 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630957824:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191669.499811:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2129
00000100:00100000:3.0:1776191669.499826:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2468
00000100:00100000:3.0:1776191669.499830:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b668658 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630957696:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191669.499838:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191669.499859:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630957824
00000100:00100000:0.0:1776191669.499882:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4971
00000100:00100000:0.0:1776191669.499885:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a27cd066 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630957824:12345-0@lo:400:kworker/u8:2.0
00010000:02020000:3.0:1776191669.499908:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191669.499913:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a27cd066 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630957824:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (75us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191669.499920:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4971
00000100:00100000:3.0:1776191669.499941:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b668658 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630957696:12345-0@lo:8:kworker/u8:2.0 Request processed in 108us (1052us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191669.499948:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2468
00000100:00100000:0.0:1776191669.499951:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d10a82b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630957504:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191669.499971:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9d67e9c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630957440:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191669.499983:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bf1af312 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630957824:0@lo:400:kworker/u8:2.0
00000100:00080000:3.0:1776191669.499996:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191669.500001:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191669.500005:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ee7172c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630957632:0@lo:8:kworker/u8:2.0
00000100:00080000:3.0:1776191669.500015:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191669.500017:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191669.500020:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000024a6daa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630957696:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191669.500243:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d808a8bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630957888:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191669.500271:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191669.500308:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630957888
00000100:00100000:1.0:1776191669.500334:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1703
00000100:00100000:1.0:1776191669.500338:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004253d689 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630957888:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191669.500358:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191669.500385:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004253d689 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630957888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (114us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191669.500391:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1703
00000100:00100000:1.0:1776191669.500422:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d808a8bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630957888:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191669.500624:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be4c283a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630957312:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191669.500636:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005eac7f74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630957568:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191669.500647:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000081563597 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630957376:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191669.500655:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec6658fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630957760:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191669.504703:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630957184
00000100:00100000:2.0:1776191669.504765:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1854
00000100:00100000:2.0:1776191669.504772:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cef7ed6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630957184:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191669.504867:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cef7ed6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630957184:12345-0@lo:400:kworker/u8:2.0 Request processed in 95us (5227us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191669.504875:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1854
00000100:00100000:0.0:1776191669.508166:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191669.508187:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008074d522 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630957952:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191669.508260:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191669.510159:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630957952
00000100:00100000:1.0:1776191669.510227:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1704
00000100:00100000:1.0:1776191669.510233:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000053bdf8f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630957952:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191669.510268:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191669.510345:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000053bdf8f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630957952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (2085us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191669.510352:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1704
00000100:00100000:1.0:1776191669.510412:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008074d522 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630957952:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191669.510449:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e1a1a8ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630957184:0@lo:400:kworker/u8:2.0
00010000:00010000:3.0:1776191670.268494:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191671.130867:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191671.130915:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191671.130957:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191671.130988:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191671.131083:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613814784
00000100:00100000:3.0:1776191671.131098:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613814720
00000100:00100000:3.0:1776191671.131137:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1855
00000100:00100000:1.0:1776191671.131144:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613814848
00000100:00100000:3.0:1776191671.131145:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000000cecea7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613814720:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191671.131167:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4972
00000100:00100000:1.0:1776191671.131172:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000024a6daa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613814784:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191671.131209:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000000cecea7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613814720:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 64us (251us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191671.131213:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000024a6daa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613814784:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 38us (352us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191671.131226:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1855
00000100:00100000:1.0:1776191671.131227:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4972
00000100:00100000:2.0:1776191671.131238:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613814912
00000100:00100000:1.0:1776191671.131251:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4973
00000100:00100000:1.0:1776191671.131258:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e1a1a8ea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613814848:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191671.131279:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2130
00000100:00100000:2.0:1776191671.131291:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ee7172c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613814912:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191671.131292:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e1a1a8ea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613814848:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 28us (296us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191671.131303:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4973
00000100:00100000:2.0:1776191671.131329:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ee7172c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613814912:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 43us (413us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191671.131336:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2130
00000100:00100000:1.0:1776191671.135136:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191671.135322:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613814976
00000100:00100000:2.0:1776191671.135374:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2469
00000100:00100000:2.0:1776191671.135380:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d808a8bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613814976:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:2.0:1776191671.135497:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191671.135564:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d808a8bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613814976:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 183us (435us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191671.135572:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2469
00010000:00010000:0.0:1776191671.290225:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191672.315327:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191672.570556:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776191672.570579:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec6658fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630958016:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191672.570656:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191672.570961:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630958016
00000100:00100000:3.0:1776191672.571131:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3381
00000100:00100000:3.0:1776191672.571138:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000cddb455 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630958016:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191672.571772:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191672.571850:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000cddb455 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630958016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 710us (1193us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191672.571858:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3381
00000100:00100000:1.0:1776191672.573193:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec6658fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630958016:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191673.342077:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191673.594533:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1776191673.594557:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c499a21 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630958080:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191673.594626:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191673.600548:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630958080
00000100:00100000:1.0:1776191673.600621:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3382
00000100:00100000:1.0:1776191673.600628:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081563597 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630958080:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191673.600666:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191673.603206:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081563597 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630958080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2570us (8573us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191673.603222:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3382
00000100:00100000:3.0:1776191673.604871:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c499a21 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630958080:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191674.363022:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1776191674.618286:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191674.618292:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191674.618296:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191674.618303:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4207
00000100:00080000:3.0:1776191674.618307:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191674.618312:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191674.618333:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000007ea65731 x1862467630958592/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191674.618351:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191674.618354:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191674.618355:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191674.618358:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4207
00000100:00080000:3.0:1776191674.618360:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191674.618362:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191674.618383:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000030eda894 x1862467630958656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191674.618430:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007ea65731 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630958592:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191674.618508:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191674.618532:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030eda894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630958656:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191674.618552:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191674.618664:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630958592
00000100:00100000:2.0:1776191674.618701:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630958656
00000100:00100000:2.0:1776191674.618718:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2470
00000100:00100000:2.0:1776191674.618723:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049908ee0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630958592:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191674.618816:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191674.618861:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049908ee0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630958592:12345-0@lo:8:kworker/u8:4.0 Request processed in 137us (354us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191674.618868:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2470
00000100:00100000:2.0:1776191674.618884:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2471
00000100:00100000:2.0:1776191674.618886:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b8ca4c1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630958656:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191674.618972:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191674.618996:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b8ca4c1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630958656:12345-0@lo:8:kworker/u8:4.0 Request processed in 108us (444us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191674.619002:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2471
00000100:00080000:2.0:1776191674.619061:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191674.619064:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191674.619068:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007ea65731 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630958592:0@lo:8:kworker/u8:4.0
00000100:00080000:2.0:1776191674.619077:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191674.619079:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191674.619082:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030eda894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630958656:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191674.619084:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be4c283a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630958208:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191674.619113:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191674.619280:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007929ecd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630958464:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191674.619302:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191674.619317:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:3.0:1776191674.619322:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bf1af312 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630958272:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191674.619344:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191674.619357:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec6658fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630958528:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191674.619359:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630958208
00000100:00100000:3.0:1776191674.619376:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191674.619388:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4974
00000100:00100000:2.0:1776191674.619392:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bfdd224e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630958208:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191674.619395:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630958464
00000100:00100000:3.0:1776191674.619416:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630958528
00000100:00100000:3.0:1776191674.619431:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2131
00000100:00100000:2.0:1776191674.619432:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bfdd224e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630958208:12345-0@lo:400:kworker/u8:4.0 Request processed in 40us (319us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191674.619435:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000067aab686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630958464:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191674.619438:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4974
00000100:00100000:3.0:1776191674.619461:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000067aab686 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630958464:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (158us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191674.619466:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2131
00000100:00100000:3.0:1776191674.619488:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2132
00000100:00100000:3.0:1776191674.619492:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000078deb88d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630958528:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191674.619515:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000078deb88d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630958528:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (138us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191674.619524:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2132
00000100:00100000:0.0:1776191674.619949:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9d67e9c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630958336:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191674.619984:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191674.620010:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630958720:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191674.620029:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191674.620062:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [3->2]
00000100:00100000:0.0:1776191674.620068:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005eac7f74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630958144:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191674.620091:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191674.620104:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d10a82b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630958400:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191674.620351:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191674.620369:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029599f7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630958784:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191674.620390:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191674.620419:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630958144
00000100:00100000:0.0:1776191674.620452:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1856
00000100:00100000:0.0:1776191674.620455:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e23389f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630958144:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191674.620494:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e23389f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630958144:12345-0@lo:400:kworker/u8:4.0 Request processed in 38us (402us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191674.620501:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1856
00000100:00100000:0.0:1776191674.620533:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630958272
00000100:00100000:2.0:1776191674.620727:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630958336
00000100:00100000:2.0:1776191674.620750:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630958720
00000100:00100000:2.0:1776191674.620768:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630958784
00000100:00100000:2.0:1776191674.620786:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4975
00000100:00100000:2.0:1776191674.620791:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb7e6216 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630958336:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191674.620824:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb7e6216 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630958336:12345-0@lo:400:kworker/u8:4.0 Request processed in 32us (840us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191674.620829:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4975
00000100:00100000:2.0:1776191674.620839:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4976
00000100:00100000:2.0:1776191674.620842:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000010d41dfd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630958720:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191674.620864:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000010d41dfd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630958720:12345-0@lo:400:kworker/u8:4.0 Request processed in 20us (835us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191674.620868:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4976
00000100:00100000:2.0:1776191674.620877:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4977
00000100:00100000:2.0:1776191674.620880:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093500675 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630958784:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191674.620903:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093500675 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630958784:12345-0@lo:400:kworker/u8:4.0 Request processed in 21us (512us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191674.620908:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4977
00000100:00100000:3.0:1776191674.620937:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec6658fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630958528:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191674.620951:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be4c283a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630958208:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191674.620961:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005eac7f74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630958144:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191674.620961:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007929ecd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630958464:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191674.620969:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029599f7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630958784:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191674.620976:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9d67e9c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630958336:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191674.620985:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630958720:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191674.621021:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630958400
00000100:00100000:0.0:1776191674.621058:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3383
00000100:00100000:0.0:1776191674.621061:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f7c58b5d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630958272:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191674.621388:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f7c58b5d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630958272:12345-0@lo:400:kworker/u8:4.0 Request processed in 324us (2042us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191674.621395:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3383
00000100:00100000:0.0:1776191674.621411:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3384
00000100:00100000:0.0:1776191674.621415:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008074d522 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630958400:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191674.621452:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008074d522 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630958400:12345-0@lo:400:kworker/u8:4.0 Request processed in 35us (1100us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191674.621458:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3384
00000100:00100000:1.0:1776191674.621495:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191674.621505:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a8f21cc1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630958848:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191674.621538:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191674.621567:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630958848
00000100:00100000:1.0:1776191674.621592:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1705
00000100:00100000:1.0:1776191674.621597:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000083657c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630958848:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191674.621619:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191674.621652:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000083657c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630958848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (114us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191674.621658:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1705
00000100:00100000:1.0:1776191674.621690:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a8f21cc1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630958848:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191674.621733:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d10a82b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630958400:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191674.621897:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d1ba4a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630958912:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191674.621923:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191674.623458:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bf1af312 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630958272:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191674.623519:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630958912
00000100:00100000:3.0:1776191674.623785:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1706
00000100:00100000:3.0:1776191674.623791:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a8f21cc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630958912:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191674.623814:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191674.626793:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a8f21cc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630958912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2994us (4863us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191674.626804:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d1ba4a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630958912:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191674.626807:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1706
00010000:00010000:3.0:1776191675.386269:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191676.251007:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191676.251090:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191676.251125:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191676.251144:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191676.251177:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191676.251762:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613815040
00000100:00100000:1.0:1776191676.251812:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1857
00000100:00100000:1.0:1776191676.251819:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4da44d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613815040:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191676.251901:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4da44d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613815040:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 70us (800us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191676.251909:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1857
00000100:00100000:1.0:1776191676.251947:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613815168
00000100:00100000:1.0:1776191676.251976:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613815104
00000100:00100000:1.0:1776191676.251999:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4978
00000100:00100000:1.0:1776191676.252003:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003ac7e5e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613815168:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191676.252072:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003ac7e5e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613815168:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 30us (909us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191676.252079:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4978
00000100:00100000:1.0:1776191676.252090:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4979
00000100:00100000:1.0:1776191676.252094:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003c7a8ed3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613815104:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191676.252115:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003c7a8ed3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613815104:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 21us (972us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191676.252121:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4979
00000100:00100000:3.0:1776191676.253535:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613815296
00000100:00100000:3.0:1776191676.253589:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613815232
00000100:00100000:3.0:1776191676.253617:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2133
00000100:00100000:3.0:1776191676.253622:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029880e2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613815232:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191676.253676:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029880e2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613815232:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 53us (2498us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191676.253683:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2133
00000100:00100000:3.0:1776191676.253698:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2472
00000100:00100000:3.0:1776191676.253702:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004790ea41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613815296:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:3.0:1776191676.253800:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191676.253826:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004790ea41 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613815296:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 123us (2829us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191676.253832:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2472
00010000:00010000:3.0:1776191676.410355:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191677.434427:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191677.690640:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d1c8a441 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630958976:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191677.690707:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191677.690813:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630958976
00000100:00100000:2.0:1776191677.690877:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3385
00000100:00100000:2.0:1776191677.690883:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003824609a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630958976:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191677.690932:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191677.690983:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003824609a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630958976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (277us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191677.690989:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3385
00000100:00100000:0.0:1776191677.691441:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d1c8a441 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630958976:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191678.458971:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191678.715418:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000033327a5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630959040:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191678.715485:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191678.715536:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630959040
00000100:00100000:1.0:1776191678.715589:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3386
00000100:00100000:1.0:1776191678.715595:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000023dd469f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630959040:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191678.715704:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191678.715758:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000023dd469f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630959040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 162us (274us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191678.715766:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3386
00000100:00100000:3.0:1776191678.715804:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000033327a5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630959040:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191679.485244:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191679.739219:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f947cdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630959104:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191679.739287:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191679.739342:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630959104
00000100:00100000:1.0:1776191679.739390:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1707
00000100:00100000:1.0:1776191679.739396:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a5f141d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630959104:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191679.739425:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191679.739473:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a5f141d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630959104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (186us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191679.739480:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1707
00000100:00080000:1.0:1776191679.739692:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191679.739697:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191679.739700:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191679.739705:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4212
00000100:00080000:1.0:1776191679.739707:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191679.739711:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191679.739728:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000999cc3c7 x1862467630959616/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191679.739743:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191679.739745:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191679.739746:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191679.739749:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4212
00000100:00080000:1.0:1776191679.739752:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191679.739754:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191679.739765:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000009eabfd74 x1862467630959680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191679.739829:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004152e894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630959360:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191679.739859:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191679.739874:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009065a894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630959744:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191679.739907:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191679.739942:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f947cdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630959104:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191679.739959:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [1->0]
00000100:00100000:1.0:1776191679.739964:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d1c8a441 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630959168:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191679.739986:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191679.740011:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bedc80a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630959424:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191679.740059:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191679.740072:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae6c8b4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630959808:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191679.740090:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191679.740114:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630959744
00000100:00100000:1.0:1776191679.740138:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630959424
00000100:00100000:1.0:1776191679.740154:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630959808
00000100:00100000:1.0:1776191679.740170:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4980
00000100:00100000:1.0:1776191679.740174:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000020539371 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630959744:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191679.740210:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000020539371 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630959744:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (302us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191679.740215:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4980
00000100:00100000:1.0:1776191679.740227:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4981
00000100:00100000:1.0:1776191679.740231:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007416a516 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630959424:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191679.740268:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007416a516 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630959424:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (210us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191679.740273:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4981
00000100:00100000:1.0:1776191679.740284:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4982
00000100:00100000:1.0:1776191679.740287:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ad77ca4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630959808:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191679.740311:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ad77ca4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630959808:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (220us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191679.740316:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4982
00000100:00100000:1.0:1776191679.740338:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630959168
00000100:00100000:1.0:1776191679.740355:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1708
00000100:00100000:1.0:1776191679.740358:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005fd6c919 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630959168:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191679.740368:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191679.740393:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005fd6c919 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630959168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (407us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191679.740398:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1708
00000100:00100000:1.0:1776191679.740423:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d1c8a441 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630959168:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191679.740432:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bedc80a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630959424:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191679.740439:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae6c8b4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630959808:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191679.740446:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009065a894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630959744:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191679.740480:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000999cc3c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630959616:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191679.740503:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191679.740517:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009eabfd74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630959680:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191679.740535:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191679.740563:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630959616
00000100:00100000:1.0:1776191679.740578:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630959680
00000100:00100000:1.0:1776191679.740589:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2473
00000100:00100000:1.0:1776191679.740592:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027f5d17c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630959616:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:1.0:1776191679.740685:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191679.740718:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027f5d17c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630959616:12345-0@lo:8:kworker/u8:2.0 Request processed in 124us (214us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191679.740724:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2473
00000100:00100000:1.0:1776191679.740734:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2474
00000100:00100000:1.0:1776191679.740737:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000259772a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630959680:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:1.0:1776191679.740825:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191679.740847:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000259772a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630959680:12345-0@lo:8:kworker/u8:2.0 Request processed in 109us (312us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191679.740853:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2474
00000100:00080000:1.0:1776191679.740879:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191679.740882:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191679.740885:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000999cc3c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630959616:0@lo:8:kworker/u8:2.0
00000100:00080000:1.0:1776191679.740892:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191679.740895:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191679.740897:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009eabfd74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630959680:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191679.741009:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003135b5de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630959232:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191679.741066:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191679.741086:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000033327a5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630959488:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191679.741110:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191679.741144:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630959360
00000100:00100000:3.0:1776191679.741168:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630959488
00000100:00100000:3.0:1776191679.741180:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3387
00000100:00100000:3.0:1776191679.741184:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070835139 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630959360:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191679.741221:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070835139 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630959360:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (1361us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191679.741226:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3387
00000100:00100000:3.0:1776191679.741238:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3388
00000100:00100000:3.0:1776191679.741242:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d1c8a441 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630959488:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191679.741260:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005cfbecd5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630959296:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191679.741272:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d1c8a441 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630959488:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (161us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191679.741279:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3388
00000100:00100000:2.0:1776191679.741302:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191679.741308:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000033327a5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630959488:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191679.741330:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c499a21 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630959552:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191679.741343:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004152e894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630959360:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191679.741358:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191679.741373:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630959296
00000100:00100000:3.0:1776191679.741400:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4983
00000100:00100000:3.0:1776191679.741404:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af2bfcf1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630959296:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191679.741412:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630959552
00000100:00100000:3.0:1776191679.741443:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af2bfcf1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630959296:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (143us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191679.741449:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2134
00000100:00100000:3.0:1776191679.741454:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4983
00000100:00100000:2.0:1776191679.741457:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000196c42f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630959552:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191679.741672:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630959232
00000100:00100000:1.0:1776191679.741754:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1858
00000100:00100000:1.0:1776191679.741759:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e54e7edc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630959232:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191679.741955:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000196c42f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630959552:12345-0@lo:400:kworker/u8:2.0 Request processed in 498us (597us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191679.741971:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2134
00000100:00100000:1.0:1776191679.742140:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e54e7edc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630959232:12345-0@lo:400:kworker/u8:2.0 Request processed in 379us (1073us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191679.742147:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1858
00000100:00100000:2.0:1776191679.742170:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003135b5de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630959232:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191679.742634:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005cfbecd5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630959296:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191679.742652:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c499a21 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630959552:0@lo:400:kworker/u8:2.0
00010000:00010000:0.0:1776191680.506386:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191681.384142:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191681.385306:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191681.385399:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191681.385435:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191681.385474:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191681.385608:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613815488
00000100:00100000:2.0:1776191681.385664:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613815424
00000100:00100000:2.0:1776191681.385687:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4984
00000100:00100000:2.0:1776191681.385692:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bf1af312 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613815488:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191681.385777:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bf1af312 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613815488:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 83us (377us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191681.385798:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4984
00000100:00100000:2.0:1776191681.385815:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4985
00000100:00100000:2.0:1776191681.385819:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d10a82b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613815424:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191681.385843:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d10a82b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613815424:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 24us (409us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191681.385850:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4985
00000100:00100000:1.0:1776191681.387941:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613815360
00000100:00100000:1.0:1776191681.387999:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1859
00000100:00100000:1.0:1776191681.388005:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f9ea876 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613815360:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191681.388086:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f9ea876 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613815360:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 81us (2785us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191681.388094:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1859
00000100:00100000:0.0:1776191681.392717:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613815616
00000100:00100000:0.0:1776191681.392771:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613815552
00000100:00100000:0.0:1776191681.392862:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2135
00000100:00100000:0.0:1776191681.392869:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f9d67e9c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613815552:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191681.392949:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f9d67e9c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613815552:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 80us (7475us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191681.392957:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2135
00000100:00100000:0.0:1776191681.392975:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2475
00000100:00100000:0.0:1776191681.392979:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ce8cc66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613815616:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:0.0:1776191681.393088:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191681.393114:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ce8cc66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613815616:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 134us (8982us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191681.393119:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2475
00010000:00010000:3.0:1776191681.533420:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191682.554599:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191682.814917:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191682.814944:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005eac7f74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630959872:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191682.815016:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191682.815358:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630959872
00000100:00100000:1.0:1776191682.815409:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3389
00000100:00100000:1.0:1776191682.815415:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008eb36e2d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630959872:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191682.815449:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191682.815500:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008eb36e2d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630959872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (485us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191682.815509:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3389
00000100:00100000:0.0:1776191682.815615:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005eac7f74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630959872:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191683.578890:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191683.836358:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009eabfd74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630959936:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191683.836431:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191683.836843:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630959936
00000100:00100000:3.0:1776191683.836899:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3390
00000100:00100000:3.0:1776191683.836905:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000b9cbeaa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630959936:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191683.836938:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191683.836994:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000b9cbeaa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630959936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (564us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191683.837001:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3390
00000100:00100000:2.0:1776191683.837091:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009eabfd74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630959936:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191684.602444:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191684.858628:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191684.858649:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008bacde2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630960000:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191684.858721:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191684.858759:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630960000
00000100:00100000:0.0:1776191684.858796:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1709
00000100:00100000:0.0:1776191684.858802:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d72c3363 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630960000:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191684.858831:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191684.858869:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d72c3363 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630960000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (149us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191684.858875:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1709
00000100:00100000:0.0:1776191684.858926:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008bacde2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630960000:0@lo:13:osp-pre-0-0.0
00000100:00080000:2.0:1776191684.859403:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191684.859408:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191684.859411:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191684.859417:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4217
00000100:00080000:2.0:1776191684.859419:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191684.859423:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191684.859441:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000d1ba4a82 x1862467630960448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191684.859455:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191684.859458:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191684.859459:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191684.859462:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4217
00000100:00080000:2.0:1776191684.859464:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191684.859467:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191684.859478:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000029599f7c x1862467630960512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191684.859513:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a61d1bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630960128:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191684.859556:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191684.859575:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000067cb6dcd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630960384:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191684.859613:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191684.859635:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:2.0:1776191684.859639:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000282b2f02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630960192:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191684.859663:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191684.859676:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630960576:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191684.859696:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191684.859737:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630960128
00000100:00100000:2.0:1776191684.859762:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630960576
00000100:00100000:2.0:1776191684.859776:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4986
00000100:00100000:2.0:1776191684.859780:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ea65731 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630960128:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191684.859815:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ea65731 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630960128:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (259us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191684.859822:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4986
00000100:00100000:2.0:1776191684.859835:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4987
00000100:00100000:2.0:1776191684.859839:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000063a7a5a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630960576:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191684.859862:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000063a7a5a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630960576:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (166us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191684.859866:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4987
00000100:00100000:2.0:1776191684.859884:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630960384
00000100:00100000:2.0:1776191684.859904:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2136
00000100:00100000:2.0:1776191684.859907:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003f4bfd6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630960384:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191684.860134:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630960576:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191684.860145:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a61d1bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630960128:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191684.860170:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000067cb6dcd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630960384:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191684.860337:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2e3253b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630960064:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191684.860408:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000157fb2fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630960256:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191684.863641:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191684.863641:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d1ba4a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630960448:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191684.863681:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003fb0e1f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630960320:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191684.863691:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191684.863714:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191684.863719:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029599f7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630960512:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191684.863728:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007929ecd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630960704:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191684.863740:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191684.863751:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191684.863782:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630960064
00000100:00100000:3.0:1776191684.863782:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630960704
00000100:00100000:0.0:1776191684.863817:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1860
00000100:00100000:3.0:1776191684.863817:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1710
00000100:00100000:0.0:1776191684.863822:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000653a1d11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630960064:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191684.863822:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c1011c34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630960704:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191684.863842:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191684.863868:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000653a1d11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630960064:12345-0@lo:400:kworker/u8:2.0 Request processed in 45us (400us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191684.863868:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c1011c34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630960704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (116us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191684.863875:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1860
00000100:00100000:3.0:1776191684.863875:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1710
00000100:00100000:3.0:1776191684.863905:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630960448
00000100:00100000:0.0:1776191684.863917:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630960192
00000100:00100000:3.0:1776191684.863926:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630960512
00000100:00100000:3.0:1776191684.863939:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2476
00000100:00100000:3.0:1776191684.863943:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be4c283a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630960448:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191684.863945:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630960320
00000100:00100000:0.0:1776191684.863956:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3391
00000100:00100000:0.0:1776191684.863959:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a96a54e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630960192:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191684.863991:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a96a54e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630960192:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (4328us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191684.863997:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3391
00000100:00100000:0.0:1776191684.864007:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3392
00000100:00100000:0.0:1776191684.864010:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008bacde2f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630960320:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191684.864051:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008bacde2f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630960320:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (329us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191684.864056:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3392
00000100:00100000:0.0:1776191684.864080:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2477
00000100:00100000:0.0:1776191684.864084:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ec6658fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630960512:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191684.864312:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:02020000:0.0:1776191684.864330:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191684.864347:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be4c283a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630960448:12345-0@lo:8:kworker/u8:2.0 Request processed in 402us (656us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191684.864352:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ec6658fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630960512:12345-0@lo:8:kworker/u8:2.0 Request processed in 267us (612us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191684.864353:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2476
00000100:00100000:0.0:1776191684.864357:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2477
00000100:00080000:3.0:1776191684.864386:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1776191684.864387:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000282b2f02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630960192:0@lo:400:kworker/u8:2.0
00000100:00080000:3.0:1776191684.864389:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191684.864392:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d1ba4a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630960448:0@lo:8:kworker/u8:2.0
00000100:00080000:3.0:1776191684.864399:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191684.864401:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191684.864403:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029599f7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630960512:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191684.864416:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2e3253b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630960064:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191684.864426:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003fb0e1f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630960320:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191684.864440:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007929ecd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630960704:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191684.864522:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191684.864549:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030eda894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630960640:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191684.864574:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191684.864622:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630960256
00000100:00100000:3.0:1776191684.864713:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630960640
00000100:00100000:2.0:1776191684.867075:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003f4bfd6c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630960384:12345-0@lo:400:kworker/u8:2.0 Request processed in 4991us (5286us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191684.867097:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2136
00000100:00100000:1.0:1776191684.867309:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4988
00000100:00100000:1.0:1776191684.867317:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009065a894 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630960256:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191684.867422:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009065a894 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630960256:12345-0@lo:400:kworker/u8:2.0 Request processed in 105us (2900us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191684.867431:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4988
00000100:00100000:2.0:1776191684.867502:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000157fb2fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630960256:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191684.867541:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4989
00000100:00100000:1.0:1776191684.867546:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae6c8b4c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630960640:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191684.867873:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae6c8b4c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630960640:12345-0@lo:400:kworker/u8:2.0 Request processed in 326us (3298us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191684.867879:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4989
00000100:00100000:2.0:1776191684.868117:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030eda894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630960640:0@lo:400:kworker/u8:2.0
00010000:00010000:3.0:1776191685.626358:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191686.498835:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191686.498894:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191686.498932:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191686.498965:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191686.499110:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191686.499145:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613815744
00000100:00100000:3.0:1776191686.499183:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613815808
00000100:00100000:3.0:1776191686.499198:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4990
00000100:00100000:3.0:1776191686.499204:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007929ecd1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613815744:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191686.499275:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007929ecd1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613815744:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 70us (381us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191686.499282:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4990
00000100:00100000:3.0:1776191686.499296:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4991
00000100:00100000:3.0:1776191686.499300:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029599f7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613815808:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191686.499321:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029599f7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613815808:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 20us (357us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191686.499327:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4991
00000100:00100000:3.0:1776191686.499347:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613815872
00000100:00100000:3.0:1776191686.499368:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613815936
00000100:00100000:3.0:1776191686.499386:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2137
00000100:00100000:3.0:1776191686.499390:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005eac7f74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613815872:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191686.499415:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005eac7f74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613815872:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 25us (484us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191686.499422:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2137
00000100:00100000:3.0:1776191686.499434:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2478
00000100:00100000:3.0:1776191686.499437:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000157fb2fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613815936:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00000100:00100000:1.0:1776191686.499800:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613815680
00000100:00100000:1.0:1776191686.499831:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1861
00000100:00100000:1.0:1776191686.499835:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd6c2b01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613815680:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191686.499878:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd6c2b01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613815680:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 42us (1052us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191686.499884:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1861
00010000:02020000:3.0:1776191686.505146:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191686.505244:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000157fb2fa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613815936:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 5804us (6133us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191686.505260:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2478
00010000:00010000:0.0:1776191686.653427:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191687.676420:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191687.930662:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1776191687.930680:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003fb0e1f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630960768:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191687.930747:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191687.931261:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630960768
00000100:00100000:3.0:1776191687.931398:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3393
00000100:00100000:3.0:1776191687.931405:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b847a9ef pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630960768:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191687.931499:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191687.931565:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b847a9ef pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630960768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 159us (819us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191687.931572:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3393
00000100:00100000:2.0:1776191687.931660:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003fb0e1f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630960768:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191688.698397:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191688.955799:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191688.955814:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009eabfd74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630960832:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191688.955890:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191688.956062:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630960832
00000100:00100000:3.0:1776191688.956112:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3394
00000100:00100000:3.0:1776191688.956118:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008831914d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630960832:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191688.956157:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191688.956211:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008831914d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630960832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (321us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191688.956219:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3394
00000100:00100000:1.0:1776191688.956297:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009eabfd74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630960832:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191689.722914:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1776191689.978474:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191689.978480:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191689.978483:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191689.978490:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4222
00000100:00080000:2.0:1776191689.978494:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191689.978499:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191689.978517:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000994ca5e2 x1862467630961344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191689.978530:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191689.978533:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191689.978534:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191689.978536:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4222
00000100:00080000:2.0:1776191689.978538:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191689.978540:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191689.978548:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000011eb3cbb x1862467630961408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191689.978586:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ff26b50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630961088:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191689.978655:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191689.978678:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000481c290f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630961472:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191689.978694:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191689.978713:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:2.0:1776191689.978718:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d9f622e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630961024:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191689.978738:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191689.978750:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003f01d2f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630961280:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191689.978768:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191689.978887:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630961088
00000100:00100000:2.0:1776191689.978922:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630961472
00000100:00100000:2.0:1776191689.978938:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4992
00000100:00100000:2.0:1776191689.978944:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000007a840d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630961088:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191689.978987:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000007a840d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630961088:12345-0@lo:400:kworker/u8:2.0 Request processed in 43us (333us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191689.978994:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4992
00000100:00100000:2.0:1776191689.979008:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4993
00000100:00100000:2.0:1776191689.979011:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e6698059 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630961472:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191689.979032:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e6698059 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630961472:12345-0@lo:400:kworker/u8:2.0 Request processed in 20us (337us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191689.979514:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000994ca5e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630961344:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191689.979546:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191689.979562:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011eb3cbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630961408:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191689.979579:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191689.979619:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630961280
00000100:00100000:3.0:1776191689.979642:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630961344
00000100:00100000:3.0:1776191689.979656:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630961408
00000100:00100000:3.0:1776191689.979669:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2138
00000100:00100000:3.0:1776191689.979673:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a66bc0f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630961280:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191689.979701:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a66bc0f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630961280:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (933us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191689.979706:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2138
00000100:00100000:3.0:1776191689.979718:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2479
00000100:00100000:3.0:1776191689.979721:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f2e3253b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630961344:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191689.979815:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191689.979848:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f2e3253b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630961344:12345-0@lo:8:kworker/u8:2.0 Request processed in 125us (301us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191689.979854:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2479
00000100:00100000:3.0:1776191689.979866:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2480
00000100:00100000:3.0:1776191689.979869:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d1ba4a82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630961408:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191689.979891:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4993
00000100:00100000:2.0:1776191689.979929:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003f01d2f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630961280:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191689.979938:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ff26b50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630961088:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191689.979945:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000481c290f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630961472:0@lo:400:kworker/u8:2.0
00010000:02020000:3.0:1776191689.979951:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191689.979972:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d1ba4a82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630961408:12345-0@lo:8:kworker/u8:2.0 Request processed in 102us (393us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191689.979980:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2480
00000100:00100000:2.0:1776191689.979989:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630961024
00000100:00100000:2.0:1776191689.980009:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3395
00000100:00080000:3.0:1776191689.980009:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1776191689.980012:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005f28ffee pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630961024:12345-0@lo:400:kworker/u8:2.0
00000100:00080000:3.0:1776191689.980012:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191689.980015:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000994ca5e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630961344:0@lo:8:kworker/u8:2.0
00000100:00080000:3.0:1776191689.980021:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191689.980024:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191689.980026:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011eb3cbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630961408:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191689.980150:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000caebeb11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630960960:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191689.980182:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191689.980200:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004250bccf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630961216:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191689.980219:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191689.980235:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [0->1]
00000100:00100000:0.0:1776191689.980240:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e600ea8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630960896:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191689.980267:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191689.980282:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009af94ad9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630961152:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191689.980304:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191689.980313:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a7f95d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630961536:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191689.980328:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191689.980350:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630961216
00000100:00100000:0.0:1776191689.980375:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2139
00000100:00100000:0.0:1776191689.980378:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc840106 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630961216:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191689.980408:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc840106 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630961216:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (189us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191689.980414:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2139
00000100:00100000:0.0:1776191689.980432:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630961152
00000100:00100000:0.0:1776191689.980446:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3396
00000100:00100000:0.0:1776191689.980449:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027e578e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630961152:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191689.980478:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027e578e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630961152:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (173us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191689.980483:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3396
00000100:00100000:1.0:1776191689.980627:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191689.980637:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000af172616 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630961600:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191689.980667:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191689.980692:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630961600
00000100:00100000:1.0:1776191689.980715:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1711
00000100:00100000:1.0:1776191689.980719:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009eabfd74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630961600:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191689.980739:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191689.980770:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009eabfd74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630961600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (103us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191689.980775:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1711
00000100:00100000:1.0:1776191689.980805:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000af172616 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630961600:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191689.980844:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630960960
00000100:00100000:1.0:1776191689.980864:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630961536
00000100:00100000:1.0:1776191689.980880:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4994
00000100:00100000:1.0:1776191689.980883:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004be80615 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630960960:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191689.980896:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005f28ffee pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630961024:12345-0@lo:400:kworker/u8:2.0 Request processed in 882us (2158us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191689.980902:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3395
00000100:00100000:1.0:1776191689.980909:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004be80615 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630960960:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (727us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191689.980913:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4994
00000100:00100000:1.0:1776191689.980927:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4995
00000100:00100000:1.0:1776191689.980930:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a3bd616 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630961536:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191689.980955:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a3bd616 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630961536:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (626us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191689.980960:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4995
00000100:00100000:1.0:1776191689.981097:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630960896
00000100:00100000:1.0:1776191689.981123:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1862
00000100:00100000:1.0:1776191689.981126:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000040bbf344 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630960896:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191689.981156:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000040bbf344 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630960896:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (888us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191689.981161:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1862
00000100:00100000:1.0:1776191689.981213:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e600ea8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630960896:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191689.981222:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009af94ad9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630961152:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191689.981232:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a7f95d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630961536:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191689.981241:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000caebeb11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630960960:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191689.981248:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004250bccf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630961216:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191689.982368:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dab16da3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630961664:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191689.982416:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191689.982460:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630961664
00000100:00100000:3.0:1776191689.982492:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1712
00000100:00100000:3.0:1776191689.982496:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000282b2f02 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630961664:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191689.982513:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191689.982545:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000282b2f02 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630961664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (130us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191689.982551:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1712
00000100:00100000:3.0:1776191689.982586:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dab16da3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630961664:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191689.983976:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d9f622e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630961024:0@lo:400:kworker/u8:2.0
00010000:00010000:3.0:1776191690.746391:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191691.610899:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191691.611068:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613816000
00000100:00100000:2.0:1776191691.611167:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1863
00000100:00100000:2.0:1776191691.611175:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bbf84eea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613816000:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191691.611261:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bbf84eea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613816000:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 85us (376us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191691.611270:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1863
00000100:00100000:0.0:1776191691.612326:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191691.612474:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613816064
00000100:00100000:3.0:1776191691.612580:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4996
00000100:00100000:3.0:1776191691.612586:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dab16da3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613816064:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191691.612731:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dab16da3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613816064:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 144us (410us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191691.612740:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4996
00000100:00100000:3.0:1776191691.620013:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191691.620101:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191691.620144:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191691.620199:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613816256
00000100:00100000:2.0:1776191691.620336:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613816192
00000100:00100000:0.0:1776191691.620417:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613816128
00000100:00100000:0.0:1776191691.620452:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 4997
00000100:00100000:0.0:1776191691.620460:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a61d1bb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613816128:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191691.620542:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a61d1bb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613816128:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 82us (397us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191691.620550:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 4997
00000100:00100000:3.0:1776191691.621263:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2140
00000100:00100000:3.0:1776191691.621685:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000067cb6dcd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613816192:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191691.621828:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000067cb6dcd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613816192:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 144us (1727us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191691.621836:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2140
00000100:00100000:3.0:1776191691.621858:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2481
00000100:00100000:3.0:1776191691.621863:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8111c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613816256:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:3.0:1776191691.621957:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191691.621988:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8111c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613816256:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 125us (1984us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191691.621995:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2481
00010000:00010000:3.0:1776191691.770300:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191692.799706:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191693.052489:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000baf461a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630961728:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191693.052728:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191693.052832:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630961728
00000100:00100000:1.0:1776191693.052883:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3397
00000100:00100000:1.0:1776191693.052888:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000205ceda0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630961728:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191693.052919:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191693.052964:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000205ceda0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630961728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (237us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191693.052970:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3397
00000100:00100000:3.0:1776191693.053215:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000baf461a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630961728:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191693.820053:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191694.074374:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191694.074391:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d808a8bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630961792:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191694.074455:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191694.074551:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630961792
00000100:00100000:1.0:1776191694.074611:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3398
00000100:00100000:1.0:1776191694.074617:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af172616 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630961792:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191694.074650:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191694.074962:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af172616 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630961792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 343us (507us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191694.074969:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3398
00000100:00100000:0.0:1776191694.075073:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d808a8bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630961792:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191694.847004:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1776191695.098614:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191695.098622:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191695.098625:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191695.098634:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4228
00000100:00080000:3.0:1776191695.098638:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191695.098643:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191695.098662:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000157fb2fa x1862467630962304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191695.098678:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191695.098681:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191695.098682:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191695.098685:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4228
00000100:00080000:3.0:1776191695.098686:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191695.098690:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191695.098701:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000f2e3253b x1862467630962368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191695.098739:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000157fb2fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630962304:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191695.098799:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191695.098824:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2e3253b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630962368:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191695.098852:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191695.098877:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029880e2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630962048:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191695.098902:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191695.098917:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d1ba4a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630962432:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191695.098937:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191695.098952:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [1->0]
00000100:00100000:3.0:1776191695.098957:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000baf461a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630961856:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191695.098984:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191695.098997:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004790ea41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630962112:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191695.099016:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191695.099028:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003fb0e1f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630962496:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191695.099132:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630962304
00000100:00100000:2.0:1776191695.099165:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630962368
00000100:00100000:2.0:1776191695.099182:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2482
00000100:00100000:2.0:1776191695.099187:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000118a85b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630962304:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191695.099281:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191695.099331:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000118a85b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630962304:12345-0@lo:8:kworker/u8:4.0 Request processed in 142us (533us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191695.099349:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2482
00000100:00100000:2.0:1776191695.099364:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2483
00000100:00100000:2.0:1776191695.099367:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000059e49ec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630962368:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191695.099448:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191695.099471:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000059e49ec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630962368:12345-0@lo:8:kworker/u8:4.0 Request processed in 103us (620us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191695.099477:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2483
00000100:00080000:2.0:1776191695.099518:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191695.099522:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191695.099526:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000157fb2fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630962304:0@lo:8:kworker/u8:4.0
00000100:00080000:2.0:1776191695.099535:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191695.099538:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191695.099540:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2e3253b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630962368:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191695.099570:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630961856
00000100:00100000:2.0:1776191695.099594:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1864
00000100:00100000:2.0:1776191695.099598:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000351c4067 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630961856:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191695.099638:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000351c4067 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630961856:12345-0@lo:400:kworker/u8:4.0 Request processed in 39us (654us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191695.099643:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1864
00000100:00100000:2.0:1776191695.099677:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630962112
00000100:00100000:2.0:1776191695.099696:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3399
00000100:00100000:2.0:1776191695.099700:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b4ee822 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630962112:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191695.099727:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b4ee822 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630962112:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (711us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191695.099734:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3399
00000100:00100000:2.0:1776191695.099767:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e24a0555 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630961920:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191695.099791:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191695.099804:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000196c42f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630962176:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191695.099821:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191695.099837:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:2.0:1776191695.099842:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ca8a173d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630961984:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191695.099861:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191695.099873:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ce8cc66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630962240:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191695.099888:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191695.099908:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630962176
00000100:00100000:2.0:1776191695.099930:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630962240
00000100:00100000:2.0:1776191695.099947:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2141
00000100:00100000:2.0:1776191695.099951:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c5289760 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630962176:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191695.099983:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c5289760 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630962176:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (162us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191695.099988:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2141
00000100:00100000:2.0:1776191695.099999:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2142
00000100:00100000:2.0:1776191695.100003:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000015a1beae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630962240:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191695.100025:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000015a1beae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630962240:12345-0@lo:400:kworker/u8:4.0 Request processed in 22us (136us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191695.100030:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2142
00000100:00100000:2.0:1776191695.104786:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ce8cc66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630962240:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191695.104807:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000196c42f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630962176:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191695.104861:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630961984
00000100:00100000:2.0:1776191695.104906:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3400
00000100:00100000:2.0:1776191695.104912:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000083bd5abd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630961984:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191695.105001:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000083bd5abd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630961984:12345-0@lo:400:kworker/u8:4.0 Request processed in 88us (5138us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191695.105008:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3400
00000100:00100000:2.0:1776191695.105031:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ca8a173d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630961984:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191695.105343:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191695.105372:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000baf461a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630961856:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191695.105384:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004790ea41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630962112:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191695.106065:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630962048
00000100:00100000:2.0:1776191695.106112:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630962432
00000100:00100000:2.0:1776191695.106129:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630961920
00000100:00100000:2.0:1776191695.106144:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630962496
00000100:00100000:2.0:1776191695.106159:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4998
00000100:00100000:2.0:1776191695.106163:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9d5bfab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630962048:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191695.106214:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9d5bfab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630962048:12345-0@lo:400:kworker/u8:4.0 Request processed in 51us (7311us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191695.106221:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4998
00000100:00100000:2.0:1776191695.106233:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4999
00000100:00100000:2.0:1776191695.106237:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000079aa8992 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630962432:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191695.106262:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000079aa8992 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630962432:12345-0@lo:400:kworker/u8:4.0 Request processed in 24us (7325us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191695.106267:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4999
00000100:00100000:2.0:1776191695.106276:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5000
00000100:00100000:2.0:1776191695.106279:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a2346a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630961920:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191695.106306:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a2346a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630961920:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (6514us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191695.106311:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5000
00000100:00100000:2.0:1776191695.106321:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5001
00000100:00100000:2.0:1776191695.106324:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036033aa5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630962496:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191695.106356:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036033aa5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630962496:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (1015us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191695.106361:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5001
00000100:00100000:2.0:1776191695.106399:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e24a0555 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630961920:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191695.106597:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000019dcd236 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630962560:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191695.106643:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191695.106667:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191695.106672:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d71ef7e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630962624:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191695.106693:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191695.106719:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630962560
00000100:00100000:0.0:1776191695.106754:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630962624
00000100:00100000:0.0:1776191695.106774:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1713
00000100:00100000:0.0:1776191695.106779:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a8e91aa5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630962560:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191695.106803:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191695.106834:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a8e91aa5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630962560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (192us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191695.106840:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1713
00000100:00100000:0.0:1776191695.106851:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1714
00000100:00100000:0.0:1776191695.106855:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a5f06cb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630962624:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191695.106865:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191695.106885:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a5f06cb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630962624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 29us (192us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191695.106889:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1714
00000100:00100000:0.0:1776191695.106926:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d71ef7e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630962624:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191695.106935:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000019dcd236 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630962560:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191695.108245:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003fb0e1f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630962496:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191695.108262:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029880e2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630962048:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191695.108272:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d1ba4a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630962432:0@lo:400:kworker/u8:4.0
00010000:00010000:0.0:1776191695.869477:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191696.733768:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191696.733848:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191696.733881:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191696.733913:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191696.733935:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191696.733999:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613816512
00000100:00100000:0.0:1776191696.734079:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613816576
00000100:00100000:0.0:1776191696.734095:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2143
00000100:00100000:0.0:1776191696.734101:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005cfbecd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613816512:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191696.734164:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005cfbecd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613816512:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 62us (316us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191696.734171:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2143
00000100:00100000:0.0:1776191696.734186:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2484
00000100:00100000:0.0:1776191696.734190:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003135b5de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613816576:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:0.0:1776191696.734284:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191696.734306:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003135b5de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613816576:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 115us (426us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191696.734311:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2484
00000100:00100000:0.0:1776191696.734418:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613816320
00000100:00100000:0.0:1776191696.734438:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1865
00000100:00100000:0.0:1776191696.734442:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048ed839b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613816320:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191696.734480:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048ed839b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613816320:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 37us (567us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191696.734486:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1865
00000100:00100000:3.0:1776191696.741202:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613816384
00000100:00100000:3.0:1776191696.741280:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613816448
00000100:00100000:3.0:1776191696.741377:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5002
00000100:00100000:3.0:1776191696.741382:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c499a21 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613816384:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191696.741471:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c499a21 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613816384:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 87us (7711us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191696.741479:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5002
00000100:00100000:3.0:1776191696.741495:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5003
00000100:00100000:3.0:1776191696.741499:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004152e894 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613816448:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191696.741522:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004152e894 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613816448:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 22us (7587us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191696.741527:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5003
00010000:00010000:3.0:1776191696.890321:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191697.914603:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191698.170325:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000049908ee0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630962688:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191698.170406:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191698.170501:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630962688
00000100:00100000:2.0:1776191698.170557:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3401
00000100:00100000:2.0:1776191698.170562:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000023d9198f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630962688:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191698.170593:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191698.170645:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000023d9198f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630962688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (241us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191698.170652:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3401
00000100:00100000:3.0:1776191698.170762:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000049908ee0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630962688:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191698.938293:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191699.194300:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000033327a5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630962752:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191699.194373:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191699.194483:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630962752
00000100:00100000:1.0:1776191699.194530:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3402
00000100:00100000:1.0:1776191699.194535:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e8472586 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630962752:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191699.194566:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191699.194612:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e8472586 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630962752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (241us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191699.194622:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3402
00000100:00100000:0.0:1776191699.194752:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000033327a5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630962752:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191699.962268:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191700.218741:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1776191700.218765:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057916d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630962816:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191700.218832:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191700.218900:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630962816
00000100:00100000:3.0:1776191700.218941:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1715
00000100:00100000:3.0:1776191700.218946:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049908ee0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630962816:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191700.218976:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191700.219017:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049908ee0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630962816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (186us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191700.219024:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1715
00000100:00100000:3.0:1776191700.219083:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057916d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630962816:0@lo:13:osp-pre-0-0.0
00000100:00080000:0.0:1776191700.220458:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191700.220465:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191700.220468:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191700.220475:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4233
00000100:00080000:0.0:1776191700.220478:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191700.220483:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191700.220503:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000057916d34 x1862467630963328/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191700.220520:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191700.220523:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191700.220524:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191700.220527:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4233
00000100:00080000:0.0:1776191700.220529:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191700.220532:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191700.220543:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000019dcd236 x1862467630963392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191700.220583:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000852fcdad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630963008:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191700.220631:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191700.220655:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c3a79bd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630963264:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191700.220680:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191700.220700:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:0.0:1776191700.220706:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000098ff6e13 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630962944:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191700.220733:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191700.220748:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000020784d50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630963200:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191700.220768:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191700.220804:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057916d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630963328:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191700.220825:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191700.220837:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000019dcd236 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630963392:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191700.221102:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630963264
00000100:00100000:2.0:1776191700.221142:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630963328
00000100:00100000:2.0:1776191700.221162:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2144
00000100:00100000:2.0:1776191700.221167:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af393e55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630963264:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191700.221219:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af393e55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630963264:12345-0@lo:400:kworker/u8:2.0 Request processed in 50us (539us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191700.221225:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2144
00000100:00100000:2.0:1776191700.221240:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2485
00000100:00100000:2.0:1776191700.221244:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e555734e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630963328:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191700.221343:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191700.221396:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e555734e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630963328:12345-0@lo:8:kworker/u8:2.0 Request processed in 151us (570us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191700.221402:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2485
00000100:00100000:2.0:1776191700.221446:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c3a79bd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630963264:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191700.221496:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630963008
00000100:00100000:2.0:1776191700.221522:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5004
00000100:00100000:2.0:1776191700.221526:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ec90674 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630963008:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191700.221556:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ec90674 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630963008:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (926us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191700.221562:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5004
00000100:00100000:2.0:1776191700.221587:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000852fcdad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630963008:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191700.221611:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630962944
00000100:00100000:2.0:1776191700.221635:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1866
00000100:00100000:2.0:1776191700.221639:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000062c92fc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630962944:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191700.221671:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000062c92fc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630962944:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (938us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191700.221677:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1866
00000100:00100000:2.0:1776191700.221708:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000098ff6e13 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630962944:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191700.222004:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1776191700.222061:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191700.222065:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191700.222068:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057916d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630963328:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191700.222143:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630963200
00000100:00100000:3.0:1776191700.222183:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3403
00000100:00100000:3.0:1776191700.222187:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e72cee95 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630963200:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191700.222226:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e72cee95 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630963200:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (1458us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191700.222232:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3403
00000100:00100000:3.0:1776191700.222257:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ce899cfc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630962880:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191700.222285:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191700.222301:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009d858fae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630963136:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191700.222325:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191700.222339:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f74cc947 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630963520:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191700.222385:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191700.222406:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:3.0:1776191700.222411:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f50805c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630963072:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191700.222433:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191700.222445:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d71ef7e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630963456:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191700.222462:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191700.222487:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630963136
00000100:00100000:3.0:1776191700.222507:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630963520
00000100:00100000:3.0:1776191700.222523:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630963456
00000100:00100000:3.0:1776191700.222538:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5005
00000100:00100000:3.0:1776191700.222542:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000067aab686 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630963136:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191700.222574:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000067aab686 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630963136:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (248us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191700.222580:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5005
00000100:00100000:3.0:1776191700.222592:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5006
00000100:00100000:3.0:1776191700.222595:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000078deb88d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630963520:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191700.222619:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000078deb88d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630963520:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (234us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191700.222625:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5006
00000100:00100000:3.0:1776191700.222634:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5007
00000100:00100000:3.0:1776191700.222638:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000259772a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630963456:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191700.222660:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000259772a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630963456:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (198us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191700.222665:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5007
00000100:00100000:3.0:1776191700.222693:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630963072
00000100:00100000:3.0:1776191700.222710:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3404
00000100:00100000:3.0:1776191700.222713:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027f5d17c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630963072:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191700.222740:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027f5d17c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630963072:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (306us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191700.222745:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3404
00000100:00100000:3.0:1776191700.222772:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000020784d50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630963200:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191700.222794:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f50805c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630963072:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191700.222803:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d71ef7e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630963456:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191700.222811:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009d858fae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630963136:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191700.222818:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f74cc947 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630963520:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191700.223148:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630962880
00000100:00100000:0.0:1776191700.223178:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1716
00000100:00100000:0.0:1776191700.223182:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b8ca4c1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630962880:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191700.223197:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191700.223235:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b8ca4c1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630962880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (949us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191700.223240:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1716
00000100:00100000:0.0:1776191700.223269:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ce899cfc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630962880:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191700.223551:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630963392
00000100:00100000:2.0:1776191700.223582:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2486
00000100:00100000:2.0:1776191700.223586:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000640b7818 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630963392:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191700.223682:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191700.223730:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000640b7818 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630963392:12345-0@lo:8:kworker/u8:2.0 Request processed in 142us (1728us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191700.223737:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2486
00000100:00080000:1.0:1776191700.223836:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191700.223840:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191700.223843:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000019dcd236 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630963392:0@lo:8:kworker/u8:2.0
00010000:00010000:3.0:1776191700.986489:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191701.859685:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191701.860664:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191701.860721:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191701.860758:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191701.860939:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613816768
00000100:00100000:3.0:1776191701.860989:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613816704
00000100:00100000:3.0:1776191701.861010:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5008
00000100:00100000:3.0:1776191701.861016:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007c618fbc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613816768:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191701.861102:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007c618fbc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613816768:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 85us (380us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191701.861110:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5008
00000100:00100000:3.0:1776191701.861126:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5009
00000100:00100000:3.0:1776191701.861130:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019361fa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613816704:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191701.861152:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019361fa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613816704:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 22us (396us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191701.861157:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5009
00000100:00100000:0.0:1776191701.861308:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191701.861432:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613816640
00000100:00100000:1.0:1776191701.861459:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1867
00000100:00100000:1.0:1776191701.861463:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c45da90d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613816640:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191701.861497:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c45da90d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613816640:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 32us (1704us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191701.861503:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1867
00000100:00100000:2.0:1776191701.870410:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613816896
00000100:00100000:2.0:1776191701.870487:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613816832
00000100:00100000:2.0:1776191701.870526:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2145
00000100:00100000:2.0:1776191701.870534:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ecc8f95b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613816832:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191701.870624:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ecc8f95b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613816832:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 90us (9316us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191701.870625:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2487
00000100:00100000:1.0:1776191701.870630:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f74cc947 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613816896:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00000100:00100000:2.0:1776191701.870632:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2145
00010000:02020000:1.0:1776191701.870728:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191701.870761:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f74cc947 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613816896:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 130us (11084us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191701.870768:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2487
00010000:00010000:3.0:1776191702.010293:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191703.040402:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191703.290733:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000019dcd236 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630963584:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191703.290814:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191703.291077:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630963584
00000100:00100000:0.0:1776191703.291130:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3405
00000100:00100000:0.0:1776191703.291137:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a6aa2ef8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630963584:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191703.291180:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191703.295814:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a6aa2ef8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630963584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4667us (4991us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191703.295830:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3405
00000100:00100000:2.0:1776191703.298404:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000019dcd236 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630963584:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191704.058502:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191704.314330:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000999cc3c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630963648:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191704.314401:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191704.314493:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630963648
00000100:00100000:0.0:1776191704.314540:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3406
00000100:00100000:0.0:1776191704.314546:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d71ef7e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630963648:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191704.314590:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191704.314636:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d71ef7e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630963648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (236us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191704.314643:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3406
00000100:00100000:3.0:1776191704.314938:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000999cc3c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630963648:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191705.084342:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191705.338470:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000182c146b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630963712:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191705.338551:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191705.338704:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630963712
00000100:00100000:2.0:1776191705.338754:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1717
00000100:00100000:2.0:1776191705.338760:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bedc80a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630963712:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191705.338792:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00080000:3.0:1776191705.338825:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191705.338831:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191705.338834:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1776191705.338838:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bedc80a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630963712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (287us total) trans 0 rc 0/0
00000100:00080000:3.0:1776191705.338842:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4238
00000100:00080000:3.0:1776191705.338847:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00100000:2.0:1776191705.338851:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1717
00000100:00080000:3.0:1776191705.338853:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191705.338875:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000e56aacf3 x1862467630964160/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191705.338880:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c31912e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630963840:0@lo:400:kworker/u8:4.0
00000100:00080000:3.0:1776191705.338897:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191705.338900:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191705.338902:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191705.338907:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4238
00000100:00080000:3.0:1776191705.338909:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191705.338913:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191705.338918:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191705.338930:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000004fd8278 x1862467630964224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191705.338937:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a4473266 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630964096:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191705.338964:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191705.338985:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:2.0:1776191705.338993:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cd188b2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630963904:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191705.338995:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630964096
00000100:00100000:2.0:1776191705.339024:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191705.339055:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2146
00000100:00100000:3.0:1776191705.339062:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1bce22f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630964096:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191705.339067:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ed42626 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630964288:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191705.339096:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191705.339138:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1bce22f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630964096:12345-0@lo:400:kworker/u8:4.0 Request processed in 76us (172us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191705.339146:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2146
00000100:00100000:2.0:1776191705.339155:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a4473266 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630964096:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191705.339179:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630963840
00000100:00100000:2.0:1776191705.339201:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000023fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630963968:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191705.339209:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630964288
00000100:00100000:2.0:1776191705.339225:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191705.339244:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b5928219 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630964352:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191705.339271:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630963968
00000100:00100000:2.0:1776191705.339280:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191705.339361:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e56aacf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630964160:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191705.339387:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191705.339402:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004fd8278 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630964224:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191705.339423:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191705.339571:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000019dcd236 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630963776:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191705.339605:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191705.339623:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc6c4887 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630964032:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191705.339643:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191705.339657:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f947cdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630964416:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191705.339676:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191705.342394:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000182c146b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630963712:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191705.342651:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630964352
00000100:00100000:3.0:1776191705.342699:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5010
00000100:00100000:3.0:1776191705.342705:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a9c33ce9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630963840:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191705.342777:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a9c33ce9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630963840:12345-0@lo:400:kworker/u8:4.0 Request processed in 72us (3863us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191705.342784:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5010
00000100:00100000:3.0:1776191705.342801:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5011
00000100:00100000:3.0:1776191705.342805:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a66bc0f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630964288:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191705.342829:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a66bc0f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630964288:12345-0@lo:400:kworker/u8:4.0 Request processed in 24us (3734us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191705.342835:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5011
00000100:00100000:3.0:1776191705.342845:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5012
00000100:00100000:3.0:1776191705.342848:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004a7f95d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630963968:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191705.342877:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004a7f95d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630963968:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (3652us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191705.342882:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5012
00000100:00100000:3.0:1776191705.342891:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5013
00000100:00100000:3.0:1776191705.342895:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a4473266 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630964352:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191705.342916:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a4473266 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630964352:12345-0@lo:400:kworker/u8:4.0 Request processed in 21us (3637us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191705.342921:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5013
00000100:00100000:3.0:1776191705.342940:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630963776
00000100:00100000:3.0:1776191705.342974:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1868
00000100:00100000:3.0:1776191705.342978:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002aaf4bb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630963776:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191705.343015:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002aaf4bb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630963776:12345-0@lo:400:kworker/u8:4.0 Request processed in 37us (3410us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191705.343019:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1868
00000100:00100000:3.0:1776191705.343071:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000023fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630963968:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191705.343082:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b5928219 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630964352:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191705.343670:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ed42626 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630964288:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191705.343685:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c31912e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630963840:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191705.343726:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630964160
00000100:00100000:3.0:1776191705.343754:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630964224
00000100:00100000:3.0:1776191705.343769:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2488
00000100:00100000:3.0:1776191705.343773:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000999cc3c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630964160:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191705.343866:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191705.343915:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000999cc3c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630964160:12345-0@lo:8:kworker/u8:4.0 Request processed in 141us (4527us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191705.343921:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2488
00000100:00100000:3.0:1776191705.343933:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2489
00000100:00100000:3.0:1776191705.343936:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000033327a5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630964224:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191705.344226:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000019dcd236 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630963776:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191705.344259:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630963904
00000100:00100000:0.0:1776191705.344298:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630964032
00000100:00100000:0.0:1776191705.344312:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3407
00000100:00100000:0.0:1776191705.344316:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ce899cfc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630963904:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191705.344363:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ce899cfc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630963904:12345-0@lo:400:kworker/u8:4.0 Request processed in 45us (5339us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191705.344368:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3407
00000100:00100000:0.0:1776191705.344380:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3408
00000100:00100000:0.0:1776191705.344383:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cfc3317d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630964032:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191705.344415:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cfc3317d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630964032:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (4772us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191705.344421:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3408
00010000:02020000:3.0:1776191705.344444:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191705.344457:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630964416
00000100:00100000:3.0:1776191705.344478:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000033327a5b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630964224:12345-0@lo:8:kworker/u8:4.0 Request processed in 540us (5054us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191705.344488:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1718
00000100:00100000:3.0:1776191705.344492:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2489
00000100:00100000:0.0:1776191705.344495:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c200fc57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630964416:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191705.344513:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191705.344529:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cd188b2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630963904:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191705.344550:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c200fc57 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630964416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (4872us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191705.344561:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1718
00000100:00100000:0.0:1776191705.344595:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc6c4887 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630964032:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191705.344616:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f947cdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630964416:0@lo:13:osp-pre-0-0.0
00000100:00080000:3.0:1776191705.344638:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191705.344642:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191705.344647:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e56aacf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630964160:0@lo:8:kworker/u8:4.0
00000100:00080000:3.0:1776191705.344656:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191705.344680:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191705.344684:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004fd8278 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630964224:0@lo:8:kworker/u8:4.0
00010000:00010000:3.0:1776191706.107345:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191706.974829:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191706.974869:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191706.974897:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191706.974935:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191706.974957:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191706.974991:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613817152
00000100:00100000:3.0:1776191706.975060:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613817216
00000100:00100000:3.0:1776191706.975082:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2147
00000100:00100000:3.0:1776191706.975089:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e56aacf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613817152:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191706.975163:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e56aacf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613817152:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 73us (265us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191706.975171:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2147
00000100:00100000:3.0:1776191706.975189:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2490
00000100:00100000:3.0:1776191706.975193:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b5928219 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613817216:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:3.0:1776191706.975297:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191706.975325:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b5928219 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613817216:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 131us (368us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191706.975332:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2490
00000100:00100000:2.0:1776191706.975520:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613817024
00000100:00100000:2.0:1776191706.975551:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613817088
00000100:00100000:2.0:1776191706.975570:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5014
00000100:00100000:2.0:1776191706.975574:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004fd8278 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613817024:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191706.975605:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004fd8278 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613817024:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 30us (737us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191706.975611:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5014
00000100:00100000:2.0:1776191706.975624:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5015
00000100:00100000:2.0:1776191706.975629:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ed42626 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613817088:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191706.975651:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ed42626 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613817088:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 21us (716us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191706.975656:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5015
00000100:00100000:1.0:1776191706.976216:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613816960
00000100:00100000:1.0:1776191706.976261:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1869
00000100:00100000:1.0:1776191706.976266:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027ca70f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613816960:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191706.976306:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027ca70f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613816960:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 40us (1486us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191706.976313:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1869
00010000:00010000:3.0:1776191707.131108:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191708.154284:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191708.411344:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191708.411363:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da0b0e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630964480:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191708.411430:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191708.411592:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630964480
00000100:00100000:3.0:1776191708.411644:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3409
00000100:00100000:3.0:1776191708.411650:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d808a8bb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630964480:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191708.411683:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191708.411733:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d808a8bb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630964480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (303us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191708.411740:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3409
00000100:00100000:1.0:1776191708.411823:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da0b0e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630964480:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191709.181841:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191709.435056:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f947cdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630964544:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191709.435126:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191709.439471:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630964544
00000100:00100000:0.0:1776191709.439588:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3410
00000100:00100000:0.0:1776191709.439594:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba9731d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630964544:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191709.439643:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191709.439711:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba9731d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630964544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (4586us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191709.439719:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3410
00000100:00100000:3.0:1776191709.439808:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f947cdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630964544:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191710.202306:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191710.458475:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191710.458500:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f947cdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630964608:0@lo:13:osp-pre-0-0.0
00000100:00080000:3.0:1776191710.458581:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191710.458585:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1776191710.458588:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1776191710.458589:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191710.458594:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4243
00000100:00080000:3.0:1776191710.458596:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191710.458601:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191710.458618:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000004385f089 x1862467630965120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191710.458627:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000690142e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630964672:0@lo:400:kworker/u8:2.0
00000100:00080000:3.0:1776191710.458629:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191710.458634:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191710.458635:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191710.458638:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4243
00000100:00080000:3.0:1776191710.458639:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191710.458642:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191710.458650:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000181f7419 x1862467630965184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191710.458668:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191710.458685:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630964608
00000100:00100000:0.0:1776191710.458688:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da0b0e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630964928:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191710.458716:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191710.458721:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1719
00000100:00100000:3.0:1776191710.458726:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019dcd236 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630964608:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191710.458739:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a7098b67 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630965312:0@lo:400:kworker/u8:2.0
00002000:00000024:3.0:1776191710.458749:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191710.458768:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191710.458791:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019dcd236 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630964608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (205us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191710.458796:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1719
00000100:00100000:0.0:1776191710.458822:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f947cdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630964608:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191710.458826:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004385f089 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630965120:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191710.458843:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:0.0:1776191710.458851:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004a57869 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630964864:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191710.458852:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191710.458875:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000181f7419 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630965184:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191710.458883:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191710.458906:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006b57c159 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630965248:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191710.458907:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191710.458949:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191710.458953:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630964672
00000100:00100000:3.0:1776191710.458984:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870
00000100:00100000:3.0:1776191710.458989:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb953a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630964672:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191710.458996:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630964928
00000100:00100000:3.0:1776191710.459052:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb953a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630964672:12345-0@lo:400:kworker/u8:2.0 Request processed in 44us (367us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191710.459053:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3411
00000100:00100000:0.0:1776191710.459061:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc840106 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630964928:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191710.459064:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870
00000100:00100000:0.0:1776191710.459105:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc840106 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630964928:12345-0@lo:400:kworker/u8:2.0 Request processed in 44us (388us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191710.459112:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3411
00000100:00100000:3.0:1776191710.459119:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000038340710 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630964800:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191710.459137:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630965312
00000100:00100000:3.0:1776191710.459148:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191710.459178:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630964864
00000100:00100000:3.0:1776191710.459180:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a0236b56 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630965056:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191710.459197:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630965248
00000100:00100000:3.0:1776191710.459204:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191710.459219:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5016
00000100:00100000:0.0:1776191710.459223:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9a725e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630965312:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191710.459225:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:3.0:1776191710.459233:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c4e82865 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630964736:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191710.459264:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9a725e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630965312:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (496us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191710.459272:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191710.459282:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5016
00000100:00100000:3.0:1776191710.459291:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c2466414 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630964992:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191710.459297:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630964736
00000100:00100000:0.0:1776191710.459312:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5017
00000100:00100000:0.0:1776191710.459316:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000012ee9fc3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630964864:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191710.459328:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191710.459356:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000012ee9fc3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630964864:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (473us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191710.459362:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5018
00000100:00100000:3.0:1776191710.459367:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008dbfa9ea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630965248:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191710.459416:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630965120
00000100:00100000:2.0:1776191710.459437:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630965184
00000100:00100000:2.0:1776191710.459448:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630965056
00000100:00100000:2.0:1776191710.459459:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630964992
00000100:00100000:2.0:1776191710.459470:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2148
00000100:00100000:2.0:1776191710.459473:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ee7172c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630965056:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191710.459511:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ee7172c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630965056:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (307us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191710.459516:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2148
00000100:00100000:2.0:1776191710.459527:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2149
00000100:00100000:2.0:1776191710.459530:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be4c283a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630964992:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191710.459552:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be4c283a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630964992:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (227us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191710.459558:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2149
00000100:00100000:2.0:1776191710.459568:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2491
00000100:00100000:2.0:1776191710.459571:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5f2099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630965120:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191710.459628:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5017
00000100:00100000:0.0:1776191710.459644:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5019
00000100:00100000:0.0:1776191710.459648:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f9d67e9c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630964736:12345-0@lo:400:kworker/u8:2.0
00010000:02020000:2.0:1776191710.459664:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191710.459684:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f9d67e9c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630964736:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (415us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191710.459693:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5019
00000100:00100000:2.0:1776191710.459708:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5f2099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630965120:12345-0@lo:8:kworker/u8:2.0 Request processed in 134us (857us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191710.459715:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2491
00000100:00100000:0.0:1776191710.459717:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630964800
00000100:00100000:2.0:1776191710.459732:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2492
00000100:00100000:2.0:1776191710.459737:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c93f941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630965184:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191710.459741:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3412
00000100:00100000:0.0:1776191710.459746:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b668658 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630964800:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191710.459775:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b668658 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630964800:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (628us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191710.459780:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3412
00010000:02020000:2.0:1776191710.459819:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191710.459837:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c93f941 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630965184:12345-0@lo:8:kworker/u8:2.0 Request processed in 101us (935us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191710.459842:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2492
00000100:00100000:3.0:1776191710.459995:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008dbfa9ea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630965248:12345-0@lo:400:kworker/u8:2.0 Request processed in 628us (1049us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191710.460001:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5018
00000100:00100000:3.0:1776191710.460068:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004a57869 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630964864:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191710.460078:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006b57c159 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630965248:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191710.460087:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a7098b67 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630965312:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191710.460094:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000690142e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630964672:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191710.460102:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da0b0e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630964928:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191710.462252:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f947cdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630965376:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191710.462550:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191710.462607:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630965376
00000100:00100000:0.0:1776191710.462643:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1720
00000100:00100000:0.0:1776191710.462649:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030eda894 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630965376:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191710.462672:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191710.462710:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030eda894 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630965376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (161us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191710.462717:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1720
00000100:00080000:2.0:1776191710.462767:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1776191710.462770:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f947cdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630965376:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1776191710.462774:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191710.462781:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004385f089 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630965120:0@lo:8:kworker/u8:2.0
00000100:00080000:2.0:1776191710.462794:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191710.462797:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191710.462812:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000181f7419 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630965184:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191710.462828:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c4e82865 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630964736:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191710.462843:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c2466414 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630964992:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191710.462855:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000038340710 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630964800:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191710.462865:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a0236b56 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630965056:0@lo:400:kworker/u8:2.0
00010000:00010000:3.0:1776191711.226860:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191712.093141:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191712.093187:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191712.093286:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613817344
00000100:00100000:0.0:1776191712.093348:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5020
00000100:00100000:0.0:1776191712.093355:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc6c4887 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613817344:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191712.093433:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc6c4887 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613817344:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 77us (301us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191712.093441:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5020
00000100:00100000:2.0:1776191712.093770:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191712.093807:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191712.093828:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613817408
00000100:00100000:2.0:1776191712.093855:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5021
00000100:00100000:2.0:1776191712.093859:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c31912e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613817408:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191712.093893:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c31912e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613817408:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 32us (86us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191712.093899:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5021
00000100:00100000:0.0:1776191712.093994:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613817280
00000100:00100000:0.0:1776191712.094026:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1871
00000100:00100000:0.0:1776191712.094031:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a5cfa2a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613817280:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191712.094097:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a5cfa2a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613817280:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 65us (328us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191712.094104:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1871
00000100:00100000:3.0:1776191712.095409:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613817472
00000100:00100000:2.0:1776191712.095745:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191712.098372:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613817536
00000100:00100000:0.0:1776191712.098471:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2150
00000100:00100000:0.0:1776191712.098479:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd188b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613817472:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191712.098576:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd188b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613817472:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 97us (5388us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191712.098583:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2150
00000100:00100000:0.0:1776191712.098795:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2493
00000100:00100000:0.0:1776191712.098800:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000023fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613817536:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:0.0:1776191712.098893:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191712.098920:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000023fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613817536:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 120us (3180us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191712.098927:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2493
00010000:00010000:3.0:1776191712.251404:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191713.274672:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191713.531286:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191713.531302:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a7098b67 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630965440:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191713.531379:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191713.531449:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630965440
00000100:00100000:3.0:1776191713.531499:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3413
00000100:00100000:3.0:1776191713.531505:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f947cdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630965440:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191713.531538:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191713.531589:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f947cdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630965440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (211us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191713.531597:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3413
00000100:00100000:1.0:1776191713.532244:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a7098b67 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630965440:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191714.298299:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191714.556992:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1776191714.557016:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043c46f30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630965504:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191714.557122:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191714.557221:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630965504
00000100:00100000:0.0:1776191714.557280:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3414
00000100:00100000:0.0:1776191714.557287:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b57c159 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630965504:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191714.557320:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191714.557374:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b57c159 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630965504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (253us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191714.557380:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3414
00000100:00100000:1.0:1776191714.557510:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000043c46f30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630965504:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191715.322388:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191715.579001:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191715.579022:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043c46f30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630965632:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191715.579123:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191715.579180:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630965632
00000100:00100000:1.0:1776191715.579222:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1721
00000100:00100000:1.0:1776191715.579228:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000086a13048 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630965632:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191715.579259:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191715.579307:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000086a13048 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630965632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (184us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191715.579315:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1721
00000100:00100000:1.0:1776191715.579361:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000043c46f30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630965632:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191715.581479:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630965568:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191715.581566:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191715.581842:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630965568
00000100:00100000:0.0:1776191715.581882:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1722
00000100:00100000:0.0:1776191715.581888:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000182c146b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630965568:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191715.581909:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191715.581945:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000182c146b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630965568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (381us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191715.581951:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1722
00000100:00080000:2.0:1776191715.583505:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191715.583512:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191715.583515:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191715.583531:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4248
00000100:00080000:2.0:1776191715.583534:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191715.583539:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191715.583559:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000852fcdad x1862467630966016/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191715.583578:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191715.583582:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191715.583583:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191715.583586:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4248
00000100:00080000:2.0:1776191715.583588:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191715.583590:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191715.583600:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000c3a79bd4 x1862467630966080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191715.583637:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000852fcdad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630966016:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191715.583687:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191715.583711:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c3a79bd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630966080:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191715.583730:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191715.583761:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000020784d50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630965824:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191715.583784:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191715.583797:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029880e2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630966208:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191715.583819:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191715.583858:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630965568:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191715.583874:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:2.0:1776191715.583879:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f50805c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630965760:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191715.583899:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191715.583912:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d1ba4a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630966144:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191715.583929:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191715.583957:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630966208
00000100:00100000:2.0:1776191715.583991:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630965760
00000100:00100000:2.0:1776191715.584004:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630966144
00000100:00100000:2.0:1776191715.584018:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5022
00000100:00100000:2.0:1776191715.584023:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000baf461a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630966208:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191715.584106:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000baf461a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630966208:12345-0@lo:400:kworker/u8:4.0 Request processed in 81us (286us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191715.584114:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5022
00000100:00100000:2.0:1776191715.584130:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5023
00000100:00100000:2.0:1776191715.584134:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ca8a173d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630965760:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191715.584159:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ca8a173d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630965760:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (260us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191715.584165:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5023
00000100:00100000:2.0:1776191715.584175:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5024
00000100:00100000:2.0:1776191715.584179:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000196c42f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630966144:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191715.584201:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000196c42f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630966144:12345-0@lo:400:kworker/u8:4.0 Request processed in 21us (272us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191715.584206:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5024
00000100:00100000:2.0:1776191715.584232:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f50805c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630965760:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191715.584241:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d1ba4a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630966144:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191715.584248:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029880e2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630966208:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191715.584503:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630966016
00000100:00100000:3.0:1776191715.584541:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2494
00000100:00100000:3.0:1776191715.584545:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003fb0e1f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630966016:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191715.584641:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191715.584681:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003fb0e1f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630966016:12345-0@lo:8:kworker/u8:4.0 Request processed in 135us (995us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191715.584687:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2494
00000100:00100000:3.0:1776191715.584700:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630966080
00000100:00100000:3.0:1776191715.584716:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2495
00000100:00100000:3.0:1776191715.584719:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e24a0555 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630966080:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191715.584803:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191715.584827:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e24a0555 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630966080:12345-0@lo:8:kworker/u8:4.0 Request processed in 106us (1097us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191715.584833:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2495
00000100:00100000:3.0:1776191715.584863:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630965824
00000100:00100000:3.0:1776191715.584890:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3415
00000100:00100000:3.0:1776191715.584895:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004790ea41 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630965824:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191715.584934:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004790ea41 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630965824:12345-0@lo:400:kworker/u8:4.0 Request processed in 39us (1149us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191715.584940:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3415
00000100:00080000:3.0:1776191715.584988:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191715.584992:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191715.584997:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000852fcdad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630966016:0@lo:8:kworker/u8:4.0
00000100:00080000:3.0:1776191715.585004:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191715.585007:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191715.585009:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c3a79bd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630966080:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191715.585319:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009d858fae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630965696:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191715.585359:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191715.585384:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000098ff6e13 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630965952:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191715.585405:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191715.585420:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191715.585426:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057916d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630965888:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191715.585447:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191715.585470:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630965888
00000100:00100000:1.0:1776191715.585494:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5025
00000100:00100000:1.0:1776191715.585498:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d31571c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630965888:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191715.585545:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d31571c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630965888:12345-0@lo:400:kworker/u8:4.0 Request processed in 46us (97us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191715.585552:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5025
00000100:00100000:1.0:1776191715.585578:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057916d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630965888:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191715.585803:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630965952
00000100:00100000:3.0:1776191715.585836:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3416
00000100:00100000:3.0:1776191715.585839:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000043c46f30 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630965952:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191715.585873:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000043c46f30 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630965952:12345-0@lo:400:kworker/u8:4.0 Request processed in 33us (467us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191715.585878:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3416
00000100:00100000:3.0:1776191715.585897:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630965696
00000100:00100000:3.0:1776191715.585917:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872
00000100:00100000:3.0:1776191715.585921:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c7de7df8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630965696:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191715.585946:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c7de7df8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630965696:12345-0@lo:400:kworker/u8:4.0 Request processed in 24us (588us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191715.585951:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872
00000100:00100000:1.0:1776191715.586855:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009d858fae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630965696:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191715.586868:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000098ff6e13 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630965952:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191715.587426:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000020784d50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630965824:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191716.346752:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191717.212109:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191717.212165:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191717.212197:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191717.212380:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613817600
00000100:00100000:2.0:1776191717.212387:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613817856
00000100:00100000:3.0:1776191717.212433:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1873
00000100:00100000:2.0:1776191717.212441:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2496
00000100:00100000:3.0:1776191717.212442:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000071188990 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613817600:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191717.212451:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000128cb0b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613817856:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00000100:00100000:3.0:1776191717.212533:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071188990 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613817600:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 92us (368us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191717.212541:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1873
00010000:02020000:2.0:1776191717.212556:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191717.212588:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000128cb0b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613817856:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 140us (486us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191717.212595:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2496
00000100:00100000:1.0:1776191717.212835:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613817728
00000100:00100000:1.0:1776191717.212875:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5026
00000100:00100000:1.0:1776191717.212880:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a0236b56 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613817728:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191717.212914:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a0236b56 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613817728:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 33us (716us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191717.212920:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5026
00000100:00100000:2.0:1776191717.215676:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191717.215721:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191717.215797:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613817792
00000100:00100000:0.0:1776191717.215849:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2151
00000100:00100000:0.0:1776191717.215856:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d1ba4a82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613817792:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191717.215931:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d1ba4a82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613817792:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 74us (209us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191717.215938:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2151
00000100:00100000:3.0:1776191717.217308:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613817664
00000100:00100000:3.0:1776191717.217370:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5027
00000100:00100000:3.0:1776191717.217375:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029880e2f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613817664:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191717.217447:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029880e2f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613817664:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 70us (1777us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191717.217455:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5027
00010000:00010000:3.0:1776191717.370379:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191718.394568:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191718.650247:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1776191718.650267:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aaba3ebf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630966272:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191718.650344:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191718.650449:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630966272
00000100:00100000:1.0:1776191718.650500:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3417
00000100:00100000:1.0:1776191718.650506:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ce8cc66 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630966272:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191718.650541:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191718.650590:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ce8cc66 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630966272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (247us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191718.650596:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3417
00000100:00100000:2.0:1776191718.650674:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aaba3ebf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630966272:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191719.418433:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191719.674313:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a0c5ca5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630966336:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191719.674399:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191719.674507:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630966336
00000100:00100000:0.0:1776191719.674558:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3418
00000100:00100000:0.0:1776191719.674564:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f2e3253b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630966336:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191719.674597:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191719.674649:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f2e3253b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630966336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (252us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191719.674655:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3418
00000100:00100000:2.0:1776191719.674735:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a0c5ca5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630966336:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191720.442392:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191720.698308:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a426c55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630966400:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191720.698392:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191720.698920:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1776191720.698947:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005eac7f74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630966464:0@lo:13:osp-pre-0-0.0
00000100:00080000:1.0:1776191720.698978:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191720.698984:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191720.698988:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1776191720.698988:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191720.698995:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4253
00000100:00080000:1.0:1776191720.698999:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191720.699005:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191720.699015:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aaba3ebf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630966656:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191720.699026:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000009c02746a x1862467630966912/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191720.699062:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191720.699064:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191720.699068:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191720.699070:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191720.699074:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4253
00000100:00080000:1.0:1776191720.699076:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191720.699080:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191720.699086:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1776191720.699093:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630966720:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191720.699118:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000081fb57bd x1862467630966976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191720.699119:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191720.699147:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630966528:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191720.699174:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191720.699201:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009df06d88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630966784:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191720.699221:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191720.699236:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:3.0:1776191720.699240:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a0c5ca5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630966592:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191720.699260:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191720.699273:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000418a6d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630966848:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191720.699292:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191720.699316:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c02746a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630966912:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191720.699351:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191720.699358:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630966400
00000100:00100000:3.0:1776191720.699368:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000081fb57bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630966976:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191720.699391:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191720.699416:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630966464
00000100:00100000:3.0:1776191720.699421:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630966656
00000100:00100000:0.0:1776191720.699445:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1723
00000100:00100000:3.0:1776191720.699445:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630966784
00000100:00100000:0.0:1776191720.699453:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ec6658fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630966400:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191720.699460:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3419
00000100:00100000:3.0:1776191720.699465:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7098b67 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630966656:12345-0@lo:400:kworker/u8:4.0
00002000:00000024:0.0:1776191720.699485:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191720.699510:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7098b67 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630966656:12345-0@lo:400:kworker/u8:4.0 Request processed in 44us (448us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191720.699518:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3419
00000100:00100000:3.0:1776191720.699536:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3420
00000100:00100000:0.0:1776191720.699540:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ec6658fe pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630966400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (1148us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191720.699542:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004385f089 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630966784:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191720.699553:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1723
00000100:00100000:0.0:1776191720.699570:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1724
00000100:00100000:0.0:1776191720.699575:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e12097 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630966464:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191720.699587:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191720.699593:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004385f089 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630966784:12345-0@lo:400:kworker/u8:4.0 Request processed in 40us (359us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191720.699601:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3420
00000100:00100000:0.0:1776191720.699618:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e12097 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630966464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (628us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191720.699625:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1724
00000100:00100000:3.0:1776191720.699635:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630966720
00000100:00100000:3.0:1776191720.699660:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630966592
00000100:00100000:3.0:1776191720.699680:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5028
00000100:00100000:3.0:1776191720.699684:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000181f7419 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630966720:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191720.699720:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000181f7419 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630966720:12345-0@lo:400:kworker/u8:4.0 Request processed in 35us (601us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191720.699727:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5028
00000100:00100000:3.0:1776191720.699740:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5029
00000100:00100000:3.0:1776191720.699745:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000038340710 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630966592:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191720.699773:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000038340710 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630966592:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (512us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191720.699781:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5029
00000100:00100000:3.0:1776191720.699805:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630966528
00000100:00100000:3.0:1776191720.699829:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1874
00000100:00100000:3.0:1776191720.699833:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c42de81a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630966528:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191720.699865:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c42de81a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630966528:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (690us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191720.699871:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1874
00000100:00100000:1.0:1776191720.699900:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630966848
00000100:00100000:3.0:1776191720.699907:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630966912
00000100:00100000:3.0:1776191720.700092:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630966976
00000100:00100000:1.0:1776191720.700377:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2152
00000100:00100000:1.0:1776191720.700382:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4e82865 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630966848:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191720.700429:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4e82865 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630966848:12345-0@lo:400:kworker/u8:4.0 Request processed in 45us (1134us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191720.700435:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2497
00000100:00100000:2.0:1776191720.700441:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004da0b0e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630966912:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191720.700536:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191720.700576:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004da0b0e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630966912:12345-0@lo:8:kworker/u8:4.0 Request processed in 134us (1226us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191720.700727:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a0c5ca5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630966592:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191720.700739:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2152
00000100:00100000:0.0:1776191720.700741:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000418a6d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630966848:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191720.700756:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630966528:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191720.700763:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2498
00000100:00100000:0.0:1776191720.700769:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009df06d88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630966784:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191720.700770:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000690142e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630966976:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191720.700806:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003fc60884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630967040:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191720.700835:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191720.700859:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630966720:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191720.700870:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aaba3ebf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630966656:0@lo:400:kworker/u8:4.0
00010000:02020000:1.0:1776191720.700877:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191720.700885:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005eac7f74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630966464:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191720.700901:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a426c55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630966400:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191720.700915:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000690142e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630966976:12345-0@lo:8:kworker/u8:4.0 Request processed in 144us (1523us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191720.700922:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2498
00000100:00100000:0.0:1776191720.700927:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191720.700946:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630967104:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191720.700972:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191720.701586:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630967040
00000100:00100000:1.0:1776191720.701626:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630967104
00000100:00100000:1.0:1776191720.701646:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5030
00000100:00100000:1.0:1776191720.701650:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000011caeb27 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630967040:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191720.701695:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000011caeb27 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630967040:12345-0@lo:400:kworker/u8:4.0 Request processed in 44us (860us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191720.701702:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5030
00000100:00100000:1.0:1776191720.701714:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5031
00000100:00100000:1.0:1776191720.701717:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c2466414 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630967104:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191720.701741:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c2466414 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630967104:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (770us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191720.701747:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5031
00000100:00100000:1.0:1776191720.701814:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630967104:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191720.701829:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003fc60884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630967040:0@lo:400:kworker/u8:4.0
00000100:00080000:1.0:1776191720.701892:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191720.701897:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191720.701901:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c02746a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630966912:0@lo:8:kworker/u8:4.0
00000100:00080000:1.0:1776191720.701910:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191720.701912:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191720.701914:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000081fb57bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630966976:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191720.702417:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2497
00010000:00010000:3.0:1776191721.466402:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191722.331849:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191722.331891:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191722.331998:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613818112
00000100:00100000:0.0:1776191722.332090:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2153
00000100:00100000:0.0:1776191722.332097:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c0e1db0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613818112:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191722.332164:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c0e1db0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613818112:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 66us (272us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191722.332175:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2153
00000100:00100000:2.0:1776191722.332177:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191722.332233:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613817920
00000100:00100000:0.0:1776191722.332255:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1875
00000100:00100000:0.0:1776191722.332259:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc7ff80b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613817920:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191722.332284:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc7ff80b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613817920:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 24us (114us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191722.332290:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1875
00000100:00100000:1.0:1776191722.332870:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191722.332962:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613817984
00000100:00100000:2.0:1776191722.333143:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613818048
00000100:00100000:0.0:1776191722.335557:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191722.335613:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613818176
00000100:00100000:0.0:1776191722.335649:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2499
00000100:00100000:0.0:1776191722.335655:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d2db40d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613818176:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:0.0:1776191722.336143:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191722.336223:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d2db40d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613818176:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 567us (670us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191722.336232:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2499
00000100:00100000:1.0:1776191722.336478:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5032
00000100:00100000:1.0:1776191722.336488:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000157fb2fa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613817984:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191722.336538:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000157fb2fa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613817984:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 51us (4707us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191722.336545:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5032
00000100:00100000:1.0:1776191722.336574:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5033
00000100:00100000:1.0:1776191722.336579:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081fb57bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613818048:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191722.336607:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081fb57bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613818048:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 27us (3905us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191722.336612:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5033
00010000:00010000:3.0:1776191722.494158:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191723.514234:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191723.772363:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191723.772392:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003fc60884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630967168:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191723.772472:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191723.772911:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630967168
00000100:00100000:0.0:1776191723.772980:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3421
00000100:00100000:0.0:1776191723.772987:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004a57869 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630967168:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191723.773022:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191723.773117:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004a57869 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630967168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (646us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191723.773125:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3421
00000100:00100000:3.0:1776191723.773182:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003fc60884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630967168:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191724.545413:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191724.794422:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630967232:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191724.794503:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191724.794747:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630967232
00000100:00100000:1.0:1776191724.794795:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3422
00000100:00100000:1.0:1776191724.794802:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000250a4bd2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630967232:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191724.794836:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191724.794899:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000250a4bd2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630967232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (397us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191724.794905:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3422
00000100:00100000:3.0:1776191724.794991:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630967232:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191725.563078:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191725.818402:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003f4bfd6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630967360:0@lo:400:kworker/u8:2.0
00000100:00080000:3.0:1776191725.818402:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191725.818410:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191725.818415:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191725.818421:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4258
00000100:00080000:3.0:1776191725.818424:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191725.818431:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191725.818453:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000a8f21cc1 x1862467630967744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191725.818468:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191725.818471:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191725.818473:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1776191725.818478:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1776191725.818479:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4258
00000100:00080000:3.0:1776191725.818484:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191725.818487:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191725.818501:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000008a5f141d x1862467630967808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191725.818523:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004253d689 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630967616:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191725.818542:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000096e89164 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630967488:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191725.818556:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191725.818577:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [2->3]
00000100:00100000:3.0:1776191725.818584:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191725.818586:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb97b35c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630967296:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191725.818606:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bedc80a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630967872:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191725.818622:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191725.818640:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191725.818645:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000035c1bc3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630967552:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191725.818667:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:3.0:1776191725.818676:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a451ede3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630967424:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191725.818677:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191725.818694:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000079eea346 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630967936:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191725.818721:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191725.818731:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191725.818756:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000083657c43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630967680:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191725.818759:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630967360
00000100:00100000:3.0:1776191725.818783:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191725.818805:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630967488
00000100:00100000:3.0:1776191725.818832:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630967872
00000100:00100000:2.0:1776191725.818844:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630967936
00000100:00100000:3.0:1776191725.818863:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5034
00000100:00100000:2.0:1776191725.818870:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5035
00000100:00100000:3.0:1776191725.818871:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c28f8aad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630967360:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191725.818878:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000069339e29 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630967488:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191725.818929:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c28f8aad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630967360:12345-0@lo:400:kworker/u8:2.0 Request processed in 59us (454us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191725.818937:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5034
00000100:00100000:2.0:1776191725.818947:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000069339e29 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630967488:12345-0@lo:400:kworker/u8:2.0 Request processed in 68us (363us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191725.818955:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5035
00000100:00100000:1.0:1776191725.819020:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a8f21cc1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630967744:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191725.819071:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191725.819088:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008a5f141d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630967808:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191725.819105:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191725.823964:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5036
00000100:00100000:3.0:1776191725.823980:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c200fc57 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630967872:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191725.824087:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c200fc57 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630967872:12345-0@lo:400:kworker/u8:2.0 Request processed in 112us (5450us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191725.824096:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5036
00000100:00100000:3.0:1776191725.824126:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5037
00000100:00100000:3.0:1776191725.824130:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000020784d50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630967936:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191725.824158:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000020784d50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630967936:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (5439us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191725.824164:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5037
00000100:00100000:3.0:1776191725.824200:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630967296
00000100:00100000:3.0:1776191725.824237:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1876
00000100:00100000:3.0:1776191725.824241:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bcb4f46f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630967296:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191725.824274:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bcb4f46f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630967296:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (5653us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191725.824280:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1876
00000100:00100000:3.0:1776191725.824314:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630967616
00000100:00100000:3.0:1776191725.824339:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630967680
00000100:00100000:3.0:1776191725.824355:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630967744
00000100:00100000:3.0:1776191725.824363:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630967808
00000100:00100000:3.0:1776191725.824371:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2154
00000100:00100000:3.0:1776191725.824374:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000282b2f02 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630967616:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191725.824403:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000282b2f02 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630967616:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (5850us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191725.824409:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2154
00000100:00100000:3.0:1776191725.824418:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2155
00000100:00100000:3.0:1776191725.824421:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000be03407 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630967680:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191725.824444:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000be03407 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630967680:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (5662us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191725.824449:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2155
00000100:00100000:3.0:1776191725.824458:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2500
00000100:00100000:3.0:1776191725.824461:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a366bf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630967744:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191725.824554:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191725.824591:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a366bf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630967744:12345-0@lo:8:kworker/u8:2.0 Request processed in 128us (5519us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191725.824597:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2500
00000100:00100000:3.0:1776191725.824607:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2501
00000100:00100000:3.0:1776191725.824611:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d5419f64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630967808:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191725.824714:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191725.824738:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d5419f64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630967808:12345-0@lo:8:kworker/u8:2.0 Request processed in 126us (5632us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191725.824744:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2501
00000100:00100000:3.0:1776191725.824767:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630967552
00000100:00100000:3.0:1776191725.824790:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630967424
00000100:00100000:3.0:1776191725.824802:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3423
00000100:00100000:3.0:1776191725.824806:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a5f06cb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630967552:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191725.824847:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a5f06cb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630967552:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (6173us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191725.824853:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3423
00000100:00100000:3.0:1776191725.824864:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3424
00000100:00100000:3.0:1776191725.824868:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b044802b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630967424:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191725.824893:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b044802b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630967424:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (6164us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191725.824899:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3424
00000100:00100000:3.0:1776191725.824985:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb97b35c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630967296:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191725.825000:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000035c1bc3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630967552:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191725.825010:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000079eea346 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630967936:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191725.825020:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004253d689 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630967616:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191725.825053:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003f4bfd6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630967360:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191725.825112:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a451ede3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630967424:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191725.825125:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000083657c43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630967680:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191725.825137:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000096e89164 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630967488:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191725.825147:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bedc80a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630967872:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191725.825246:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004905ea34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630968000:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191725.825281:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191725.825322:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630968000
00000100:00100000:3.0:1776191725.825348:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1725
00000100:00100000:3.0:1776191725.825352:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a8e91aa5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630968000:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191725.825372:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191725.825402:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a8e91aa5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630968000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (122us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191725.825407:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1725
00000100:00100000:3.0:1776191725.825428:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004905ea34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630968000:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191725.825489:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191725.825494:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004905ea34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630968064:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191725.825516:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191725.825534:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630968064
00000100:00100000:3.0:1776191725.825553:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1726
00000100:00100000:3.0:1776191725.825556:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019dcd236 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630968064:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191725.825564:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191725.825588:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019dcd236 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630968064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 31us (72us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191725.825593:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1726
00000100:00100000:3.0:1776191725.825613:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004905ea34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630968064:0@lo:13:osp-pre-0-0.0
00000100:00080000:3.0:1776191725.825660:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191725.825664:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191725.825667:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a8f21cc1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630967744:0@lo:8:kworker/u8:2.0
00000100:00080000:3.0:1776191725.825675:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191725.825677:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191725.825680:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008a5f141d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630967808:0@lo:8:kworker/u8:2.0
00010000:00010000:3.0:1776191726.586217:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191727.452115:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191727.452216:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613818240
00000100:00100000:3.0:1776191727.452276:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1877
00000100:00100000:3.0:1776191727.452283:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ac96f048 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613818240:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191727.452726:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ac96f048 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613818240:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 442us (620us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191727.452735:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1877
00000100:00100000:2.0:1776191727.452899:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191727.453084:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613818304
00000100:00100000:3.0:1776191727.453127:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5038
00000100:00100000:3.0:1776191727.453132:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000098ff6e13 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613818304:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191727.453177:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000098ff6e13 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613818304:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 44us (279us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191727.453183:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5038
00000100:00100000:0.0:1776191727.453910:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191727.453990:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191727.454021:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191727.454237:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613818432
00000100:00100000:3.0:1776191727.454277:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613818496
00000100:00100000:3.0:1776191727.454296:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2156
00000100:00100000:3.0:1776191727.454301:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030eda894 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613818432:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191727.454352:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030eda894 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613818432:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 50us (362us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191727.454358:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2156
00000100:00100000:3.0:1776191727.454371:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2502
00000100:00100000:3.0:1776191727.454374:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a426c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613818496:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:3.0:1776191727.454464:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191727.454605:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a426c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613818496:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 229us (583us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191727.454612:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2502
00000100:00100000:1.0:1776191727.454737:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613818368
00000100:00100000:1.0:1776191727.454819:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5039
00000100:00100000:1.0:1776191727.454823:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f43f1e37 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613818368:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191727.454903:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f43f1e37 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613818368:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 78us (995us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191727.454910:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5039
00010000:00010000:3.0:1776191727.610590:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191728.634410:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191728.890768:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc54e5ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630968128:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191728.890845:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191728.890984:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630968128
00000100:00100000:2.0:1776191728.891058:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3425
00000100:00100000:2.0:1776191728.891064:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004905ea34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630968128:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191728.891112:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191728.894916:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc54e5ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630968128:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191728.895533:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004905ea34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630968128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4466us (4686us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191728.895546:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3425
00010000:00010000:3.0:1776191729.660514:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191729.916700:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191729.916723:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0c75a22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630968192:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191729.916805:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191729.917261:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630968192
00000100:00100000:2.0:1776191729.917315:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3426
00000100:00100000:2.0:1776191729.917321:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aaba3ebf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630968192:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191729.917352:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191729.917420:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aaba3ebf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630968192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (615us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191729.917426:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3426
00000100:00100000:0.0:1776191729.917615:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0c75a22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630968192:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191730.685182:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191730.938789:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000695c22eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630968320:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191730.938858:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191730.938911:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630968320
00000100:00100000:1.0:1776191730.938964:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1727
00000100:00100000:1.0:1776191730.938970:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fdf2aa68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630968320:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191730.938998:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191730.939056:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fdf2aa68 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630968320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (198us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191730.939063:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1727
00000100:00100000:1.0:1776191730.939109:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000695c22eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630968320:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1776191730.940694:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191730.940700:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191730.940703:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191730.940720:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4263
00000100:00080000:0.0:1776191730.940723:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191730.940729:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191730.940749:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000ec6658fe x1862467630968768/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191730.940767:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191730.940770:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191730.940772:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191730.940774:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4263
00000100:00080000:0.0:1776191730.940776:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191730.940779:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191730.940790:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000047404be6 x1862467630968832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191730.940839:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec6658fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630968768:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191730.940897:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191730.940920:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000047404be6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630968832:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191730.940954:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191730.940985:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630968768
00000100:00100000:0.0:1776191730.941013:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630968832
00000100:00100000:0.0:1776191730.941060:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2503
00000100:00100000:0.0:1776191730.941065:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a1a9e6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630968768:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191730.941158:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191730.941196:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a1a9e6f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630968768:12345-0@lo:8:kworker/u8:4.0 Request processed in 130us (311us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191730.941204:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2503
00000100:00100000:0.0:1776191730.941220:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2504
00000100:00100000:0.0:1776191730.941223:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000058835de5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630968832:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191730.941301:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191730.941323:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000058835de5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630968832:12345-0@lo:8:kworker/u8:4.0 Request processed in 99us (381us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191730.941329:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2504
00000100:00100000:2.0:1776191730.941593:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a0c5ca5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630968448:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191730.941626:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191730.941647:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f04c7a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630968704:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191730.941682:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191730.941700:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:2.0:1776191730.941706:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630968384:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191730.941745:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191730.941759:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005eac7f74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630968640:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191730.941779:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191730.941803:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630968704
00000100:00100000:2.0:1776191730.941834:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2157
00000100:00100000:2.0:1776191730.941838:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000057916d34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630968704:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191730.941877:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000057916d34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630968704:12345-0@lo:400:kworker/u8:4.0 Request processed in 38us (195us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191730.941883:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2157
00000100:00100000:2.0:1776191730.941903:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630968448
00000100:00100000:2.0:1776191730.941924:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5040
00000100:00100000:2.0:1776191730.941928:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d858fae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630968448:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191730.941966:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d858fae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630968448:12345-0@lo:400:kworker/u8:4.0 Request processed in 37us (340us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191730.941972:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5040
00000100:00100000:2.0:1776191730.942000:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086a13048 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630968512:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191730.942024:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191730.942061:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000989821a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630968896:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191730.942081:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191730.942099:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:2.0:1776191730.942104:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000182c146b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630968576:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191730.942123:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191730.942137:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d7848e1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630968960:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191730.942156:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191730.942187:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630968640
00000100:00100000:2.0:1776191730.942210:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630968512
00000100:00100000:2.0:1776191730.942221:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3427
00000100:00100000:2.0:1776191730.942225:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c3a79bd4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630968640:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191730.942254:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c3a79bd4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630968640:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (475us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191730.942260:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3427
00000100:00100000:2.0:1776191730.942270:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3428
00000100:00100000:2.0:1776191730.942274:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000852fcdad pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630968512:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191730.942301:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000852fcdad pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630968512:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (276us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191730.942307:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3428
00000100:00100000:2.0:1776191730.942323:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630968896
00000100:00100000:2.0:1776191730.942342:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630968576
00000100:00100000:2.0:1776191730.942355:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630968960
00000100:00100000:3.0:1776191730.942595:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5041
00000100:00100000:3.0:1776191730.942600:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f50805c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630968896:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191730.942634:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f50805c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630968896:12345-0@lo:400:kworker/u8:4.0 Request processed in 33us (553us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191730.942640:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5041
00000100:00100000:3.0:1776191730.942728:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5042
00000100:00100000:3.0:1776191730.942732:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d0e4254d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630968576:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191730.942760:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d0e4254d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630968576:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (636us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191730.942766:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5042
00000100:00100000:3.0:1776191730.942831:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005eac7f74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630968640:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191730.942844:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a0c5ca5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630968448:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191730.942852:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f04c7a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630968704:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191730.942868:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191730.942876:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003f4bfd6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630968256:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191730.942901:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191730.943519:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000182c146b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630968576:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191730.943537:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086a13048 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630968512:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191730.943547:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000989821a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630968896:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191730.944494:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630968256
00000100:00100000:1.0:1776191730.944549:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1728
00000100:00100000:1.0:1776191730.944554:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000f04c7a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630968256:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191730.944578:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191730.944634:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000f04c7a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630968256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (1733us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191730.944642:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1728
00000100:00100000:2.0:1776191730.945143:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5043
00000100:00100000:2.0:1776191730.945147:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d9f622e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630968960:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191730.945200:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d9f622e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630968960:12345-0@lo:400:kworker/u8:4.0 Request processed in 51us (3043us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191730.945206:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5043
00000100:00100000:2.0:1776191730.945240:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d7848e1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630968960:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191730.945287:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630968384
00000100:00100000:2.0:1776191730.945311:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1878
00000100:00100000:2.0:1776191730.945314:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b37044fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630968384:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191730.945345:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b37044fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630968384:12345-0@lo:400:kworker/u8:4.0 Request processed in 29us (3599us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191730.945350:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1878
00000100:00100000:1.0:1776191730.945581:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003f4bfd6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630968256:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191730.945591:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630968384:0@lo:400:kworker/u8:4.0
00000100:00080000:0.0:1776191730.946044:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191730.946049:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191730.946055:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec6658fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630968768:0@lo:8:kworker/u8:4.0
00000100:00080000:0.0:1776191730.946072:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191730.946075:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191730.946077:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000047404be6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630968832:0@lo:8:kworker/u8:4.0
00010000:00010000:3.0:1776191731.706287:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191732.571494:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191732.571738:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191732.571773:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191732.571806:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191732.571879:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191732.571934:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613818624
00000100:00100000:0.0:1776191732.571979:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5044
00000100:00100000:0.0:1776191732.571985:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000047404be6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613818624:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191732.572112:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000047404be6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613818624:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 125us (374us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191732.572120:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5044
00000100:00100000:0.0:1776191732.572138:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613818688
00000100:00100000:0.0:1776191732.572157:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5045
00000100:00100000:0.0:1776191732.572161:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a1a9e6f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613818688:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191732.572170:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613818560
00000100:00100000:0.0:1776191732.572187:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a1a9e6f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613818688:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 25us (308us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191732.572193:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5045
00000100:00100000:2.0:1776191732.572193:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1879
00000100:00100000:2.0:1776191732.572197:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004e50600 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613818560:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191732.572220:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004e50600 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613818560:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 22us (736us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191732.572226:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1879
00000100:00100000:1.0:1776191732.572328:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613818816
00000100:00100000:1.0:1776191732.572358:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613818752
00000100:00100000:1.0:1776191732.572386:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2158
00000100:00100000:1.0:1776191732.572391:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000059e49ec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613818752:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191732.572433:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000059e49ec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613818752:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 41us (627us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191732.572438:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2158
00000100:00100000:1.0:1776191732.572450:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2505
00000100:00100000:1.0:1776191732.572454:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000118a85b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613818816:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:1.0:1776191732.572549:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191732.572574:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000118a85b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613818816:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 119us (802us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191732.572581:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2505
00010000:00010000:3.0:1776191732.734233:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191733.754555:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191734.010215:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000695c22eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630969024:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191734.010283:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191734.010380:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630969024
00000100:00100000:0.0:1776191734.010435:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3429
00000100:00100000:0.0:1776191734.010446:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005eac7f74 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630969024:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191734.010480:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191734.010537:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005eac7f74 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630969024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (256us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191734.010544:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3429
00000100:00100000:2.0:1776191734.010595:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000695c22eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630969024:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191734.778227:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191735.034553:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb143dd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630969088:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191735.034635:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191735.034729:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630969088
00000100:00100000:0.0:1776191735.034776:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3430
00000100:00100000:0.0:1776191735.034781:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ec6658fe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630969088:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191735.034812:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191735.037092:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ec6658fe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630969088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2302us (2450us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191735.037105:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3430
00000100:00100000:3.0:1776191735.037251:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb143dd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630969088:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191735.802256:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1776191736.058472:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191736.058479:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191736.058483:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191736.058489:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4269
00000100:00080000:3.0:1776191736.058492:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191736.058498:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191736.058517:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000182c146b x1862467630969600/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191736.058530:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191736.058533:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191736.058534:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191736.058537:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4269
00000100:00080000:3.0:1776191736.058538:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191736.058541:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191736.058551:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000ecc8f95b x1862467630969664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191736.058596:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ee7172c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630969152:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191736.058670:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191736.058691:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c5289760 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630969408:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191736.058713:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191736.058725:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005cfbecd5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630969792:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191736.058745:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191736.058777:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:3.0:1776191736.058783:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004c93f941 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630969344:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191736.058816:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191736.058829:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000079eea346 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630969728:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191736.058848:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191736.058873:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be4c283a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630969216:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191736.058892:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191736.058907:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015a1beae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630969472:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191736.058927:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191736.058941:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:3.0:1776191736.058945:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd5f2099 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630969280:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191736.058965:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191736.058977:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1bce22f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630969536:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191736.058994:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191736.059025:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630969152
00000100:00100000:3.0:1776191736.059084:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1880
00000100:00100000:3.0:1776191736.059090:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f9005e31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630969152:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191736.059145:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f9005e31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630969152:12345-0@lo:400:kworker/u8:4.0 Request processed in 54us (475us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191736.059152:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1880
00000100:00100000:3.0:1776191736.059180:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630969792
00000100:00100000:3.0:1776191736.059204:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630969344
00000100:00100000:3.0:1776191736.059218:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630969728
00000100:00100000:3.0:1776191736.059229:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630969216
00000100:00100000:3.0:1776191736.059239:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5046
00000100:00100000:3.0:1776191736.059242:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000999cc3c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630969792:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191736.059271:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000999cc3c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630969792:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (525us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191736.059277:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5046
00000100:00100000:3.0:1776191736.059288:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5047
00000100:00100000:3.0:1776191736.059291:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000033327a5b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630969344:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191736.059316:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000033327a5b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630969344:12345-0@lo:400:kworker/u8:4.0 Request processed in 24us (500us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191736.059321:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5047
00000100:00100000:3.0:1776191736.059331:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5048
00000100:00100000:3.0:1776191736.059334:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a5f141d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630969728:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191736.059355:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a5f141d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630969728:12345-0@lo:400:kworker/u8:4.0 Request processed in 21us (507us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191736.059361:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5048
00000100:00100000:3.0:1776191736.059370:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5049
00000100:00100000:3.0:1776191736.059373:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a8f21cc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630969216:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191736.059400:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a8f21cc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630969216:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (507us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191736.059405:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5049
00000100:00100000:3.0:1776191736.059431:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630969472
00000100:00100000:3.0:1776191736.059455:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630969536
00000100:00100000:3.0:1776191736.059474:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2159
00000100:00100000:3.0:1776191736.059478:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bedc80a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630969472:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191736.059482:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630969408
00000100:00100000:1.0:1776191736.059510:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630969280
00000100:00100000:3.0:1776191736.059513:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bedc80a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630969472:12345-0@lo:400:kworker/u8:4.0 Request processed in 33us (585us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191736.059520:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2159
00000100:00100000:1.0:1776191736.059527:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3431
00000100:00100000:1.0:1776191736.059532:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003135b5de pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630969408:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191736.059537:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2160
00000100:00100000:3.0:1776191736.059543:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000083657c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630969536:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191736.059578:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003135b5de pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630969408:12345-0@lo:400:kworker/u8:4.0 Request processed in 45us (863us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191736.059585:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000083657c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630969536:12345-0@lo:400:kworker/u8:4.0 Request processed in 40us (588us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191736.059587:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3431
00000100:00100000:3.0:1776191736.059596:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2160
00000100:00100000:1.0:1776191736.059620:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3432
00000100:00100000:1.0:1776191736.059632:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096e89164 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630969280:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191736.059660:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096e89164 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630969280:12345-0@lo:400:kworker/u8:4.0 Request processed in 34us (695us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191736.059666:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3432
00000100:00100000:3.0:1776191736.059676:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1bce22f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630969536:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191736.059695:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be4c283a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630969216:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191736.059708:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015a1beae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630969472:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191736.059713:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1776191736.059726:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ebe193c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630969856:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191736.059740:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd5f2099 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630969280:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191736.059774:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004c93f941 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630969344:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191736.059781:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191736.059791:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000182c146b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630969600:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191736.059792:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000079eea346 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630969728:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191736.059812:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ee7172c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630969152:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191736.059823:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630969856
00000100:00100000:1.0:1776191736.059828:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191736.059829:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c5289760 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630969408:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191736.059836:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191736.059837:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008611bf7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630969920:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191736.059847:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005cfbecd5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630969792:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191736.059868:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ecc8f95b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630969664:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191736.059901:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630969600
00000100:00100000:3.0:1776191736.059920:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2506
00000100:00100000:3.0:1776191736.059923:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000053bdf8f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630969600:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191736.059955:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191736.059982:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630969920
00000100:00100000:1.0:1776191736.060005:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1729
00000100:00100000:1.0:1776191736.060009:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e72ff9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630969920:12345-0@lo:13:osp-pre-0-0.0
00010000:02020000:3.0:1776191736.060012:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00002000:00000024:1.0:1776191736.060056:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191736.060073:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000053bdf8f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630969600:12345-0@lo:8:kworker/u8:4.0 Request processed in 148us (241us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191736.060081:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2506
00000100:00100000:2.0:1776191736.060099:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1730
00000100:00100000:1.0:1776191736.060102:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e72ff9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630969920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (145us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191736.060108:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004250bccf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630969856:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191736.060114:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1729
00002000:00000024:2.0:1776191736.060122:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191736.060154:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008611bf7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630969920:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191736.060180:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004250bccf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630969856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (402us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191736.060189:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1730
00000100:00100000:0.0:1776191736.060259:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1776191736.060294:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191736.060298:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191736.060302:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000182c146b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630969600:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191736.060512:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630969664
00000100:00100000:2.0:1776191736.060541:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2507
00000100:00100000:2.0:1776191736.060545:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d7848e1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630969664:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191736.060645:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191736.060685:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d7848e1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630969664:12345-0@lo:8:kworker/u8:4.0 Request processed in 139us (427us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191736.060692:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2507
00000100:00080000:0.0:1776191736.060760:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191736.060764:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191736.060767:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ecc8f95b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630969664:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191736.060912:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ebe193c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630969856:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1776191736.826249:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191737.692843:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191737.692893:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191737.692931:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191737.693096:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613818944
00000100:00100000:3.0:1776191737.693214:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5050
00000100:00100000:3.0:1776191737.693221:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000989821a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613818944:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191737.693290:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000989821a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613818944:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 69us (396us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191737.693298:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5050
00000100:00100000:3.0:1776191737.693334:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191737.693436:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191737.693458:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613819008
00000100:00100000:3.0:1776191737.693479:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5051
00000100:00100000:3.0:1776191737.693483:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a451ede3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613819008:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191737.693510:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a451ede3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613819008:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 26us (75us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191737.693516:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5051
00000100:00100000:2.0:1776191737.693622:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613818880
00000100:00100000:2.0:1776191737.693664:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1881
00000100:00100000:2.0:1776191737.693669:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000961e9bab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613818880:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191737.693707:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000961e9bab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613818880:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 37us (873us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191737.693714:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1881
00000100:00100000:0.0:1776191737.693728:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613819072
00000100:00100000:0.0:1776191737.693756:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613819136
00000100:00100000:2.0:1776191737.693763:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2161
00000100:00100000:2.0:1776191737.693769:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e56aacf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613819072:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191737.693897:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e56aacf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613819072:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 126us (965us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191737.694659:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2508
00000100:00100000:0.0:1776191737.694666:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005cfbecd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613819136:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:0.0:1776191737.694765:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191737.694817:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005cfbecd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613819136:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 151us (1484us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191737.694823:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2508
00000100:00100000:2.0:1776191737.695545:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2161
00010000:00010000:3.0:1776191737.850456:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191738.874370:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191739.133771:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191739.133806:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008611bf7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630969984:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191739.133877:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191739.134295:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630969984
00000100:00100000:2.0:1776191739.134343:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3433
00000100:00100000:2.0:1776191739.134348:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b5928219 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630969984:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191739.134378:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191739.134425:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b5928219 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630969984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (549us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191739.134432:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3433
00000100:00100000:0.0:1776191739.135354:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008611bf7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630969984:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191739.898257:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191740.154267:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004253d689 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630970048:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191740.154354:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191740.154445:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630970048
00000100:00100000:1.0:1776191740.154498:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3434
00000100:00100000:1.0:1776191740.154504:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000caebeb11 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630970048:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191740.154551:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191740.154608:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000caebeb11 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630970048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (255us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191740.154615:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3434
00000100:00100000:0.0:1776191740.154789:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004253d689 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630970048:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191740.922390:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191741.178537:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776191741.178606:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d2db40d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630970176:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191741.178659:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000035c1bc3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630970112:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191741.178677:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191741.178719:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630970176
00000100:00100000:1.0:1776191741.178756:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1882
00000100:00100000:1.0:1776191741.178762:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dce6a0d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630970176:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191741.178820:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dce6a0d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630970176:12345-0@lo:400:kworker/u8:4.0 Request processed in 46us (133us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191741.178828:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1882
00000100:00100000:1.0:1776191741.178876:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d2db40d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630970176:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191741.178906:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191741.180924:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630970112
00000100:00100000:1.0:1776191741.180993:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1731
00000100:00100000:1.0:1776191741.180999:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004253d689 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630970112:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191741.181062:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191741.181373:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d1858cc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630970240:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191741.181413:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1776191741.181712:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191741.181717:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191741.181720:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191741.181725:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4274
00000100:00080000:0.0:1776191741.181727:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191741.181732:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191741.181749:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000d1ba4a82 x1862467630970560/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191741.181763:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191741.181765:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191741.181767:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191741.181770:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4274
00000100:00080000:0.0:1776191741.181772:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191741.181775:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191741.181783:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000005c0e1db0 x1862467630970624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191741.181825:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d1ba4a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630970560:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191741.181856:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191741.181873:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005c0e1db0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630970624:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191741.181889:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191741.182240:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630970240
00000100:00100000:2.0:1776191741.182274:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1732
00000100:00100000:2.0:1776191741.182279:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009af94ad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630970240:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191741.182294:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191741.182327:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009af94ad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630970240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (914us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191741.182333:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1732
00000100:00100000:3.0:1776191741.183650:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000067cb6dcd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630970368:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191741.183707:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191741.183736:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000be03407 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630970752:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191741.183759:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191741.183841:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004253d689 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630970112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2839us (4935us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191741.183859:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1731
00000100:00100000:2.0:1776191741.186498:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003fb0e1f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630970432:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191741.186576:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630970368
00000100:00100000:2.0:1776191741.186621:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3435
00000100:00100000:2.0:1776191741.186626:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ecc8f95b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630970368:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191741.186674:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ecc8f95b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630970368:12345-0@lo:400:kworker/u8:4.0 Request processed in 48us (2969us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191741.186681:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3435
00000100:00100000:2.0:1776191741.186708:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e24a0555 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630970496:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191741.186731:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191741.186752:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:2.0:1776191741.186757:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d2db40d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630970304:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191741.186781:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630970496
00000100:00100000:2.0:1776191741.186798:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3436
00000100:00100000:2.0:1776191741.186801:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e600ea8b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630970496:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191741.186841:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e600ea8b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630970496:12345-0@lo:400:kworker/u8:4.0 Request processed in 39us (111us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191741.186846:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3436
00000100:00100000:2.0:1776191741.186884:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d1858cc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630970240:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191741.188086:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630970560
00000100:00100000:0.0:1776191741.188119:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630970624
00000100:00100000:0.0:1776191741.188138:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2509
00000100:00100000:0.0:1776191741.188142:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000128cb0b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630970560:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191741.188366:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191741.188419:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000128cb0b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630970560:12345-0@lo:8:kworker/u8:4.0 Request processed in 275us (6563us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191741.188499:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2509
00000100:00100000:0.0:1776191741.188513:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2510
00000100:00100000:0.0:1776191741.188517:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030eda894 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630970624:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191741.188597:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191741.188618:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030eda894 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630970624:12345-0@lo:8:kworker/u8:4.0 Request processed in 101us (6729us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191741.188623:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2510
00000100:00080000:0.0:1776191741.188662:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191741.188666:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191741.188669:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d1ba4a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630970560:0@lo:8:kworker/u8:4.0
00000100:00080000:0.0:1776191741.188677:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191741.188679:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191741.188681:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005c0e1db0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630970624:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191741.190693:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000035c1bc3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630970112:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191741.190730:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000067cb6dcd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630970368:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191741.190763:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191741.190798:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630970752
00000100:00100000:3.0:1776191741.190831:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630970432
00000100:00100000:3.0:1776191741.190848:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5052
00000100:00100000:3.0:1776191741.190855:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000079eea346 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630970752:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191741.190913:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000079eea346 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630970752:12345-0@lo:400:kworker/u8:4.0 Request processed in 58us (7154us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191741.190920:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5052
00000100:00100000:3.0:1776191741.190934:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5053
00000100:00100000:3.0:1776191741.190938:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000035c1bc3b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630970432:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191741.190966:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000035c1bc3b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630970432:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (204us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191741.190972:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5053
00000100:00100000:3.0:1776191741.190997:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003fb0e1f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630970432:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191741.191021:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000be03407 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630970752:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191741.191541:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191741.191573:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000282b2f02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630970688:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191741.191591:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630970304
00000100:00100000:2.0:1776191741.191608:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191741.195120:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630970688
00000100:00100000:2.0:1776191741.195141:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e24a0555 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630970496:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191741.195177:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5054
00000100:00100000:0.0:1776191741.195184:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ff26b50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630970304:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191741.195251:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ff26b50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630970304:12345-0@lo:400:kworker/u8:4.0 Request processed in 67us (3711us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191741.195258:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5054
00000100:00100000:2.0:1776191741.195636:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d2db40d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630970304:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191741.195798:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5055
00000100:00100000:1.0:1776191741.195804:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000011eb3cbb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630970688:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191741.195929:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000011eb3cbb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630970688:12345-0@lo:400:kworker/u8:4.0 Request processed in 124us (4322us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191741.195936:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5055
00000100:00100000:2.0:1776191741.198526:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000282b2f02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630970688:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191741.950846:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191742.810645:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191742.810701:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191742.810800:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191742.810839:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191742.810885:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613819264
00000100:00100000:3.0:1776191742.810936:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613819328
00000100:00100000:3.0:1776191742.810958:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5056
00000100:00100000:3.0:1776191742.810965:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000be03407 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613819264:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191742.811080:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000be03407 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613819264:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 114us (444us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191742.811092:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5056
00000100:00100000:3.0:1776191742.811109:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5057
00000100:00100000:3.0:1776191742.811113:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c93f941 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613819328:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191742.811137:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c93f941 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613819328:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 23us (299us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191742.811143:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5057
00000100:00100000:1.0:1776191742.811157:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613819392
00000100:00100000:1.0:1776191742.811183:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2162
00000100:00100000:1.0:1776191742.811187:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ee7172c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613819392:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:1.0:1776191742.811214:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ee7172c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613819392:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 26us (415us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191742.811220:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2162
00000100:00100000:2.0:1776191742.812726:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613819200
00000100:00100000:2.0:1776191742.812773:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1883
00000100:00100000:2.0:1776191742.812778:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd42e839 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613819200:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191742.812835:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd42e839 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613819200:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 57us (2135us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191742.812843:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1883
00000100:00100000:0.0:1776191742.813379:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191742.813702:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613819456
00000100:00100000:2.0:1776191742.813739:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2511
00000100:00100000:2.0:1776191742.813744:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000282b2f02 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613819456:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:2.0:1776191742.813841:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191742.814026:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000282b2f02 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613819456:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 280us (649us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191742.814054:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2511
00010000:00010000:3.0:1776191742.971079:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191743.995283:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191744.250420:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007311be7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630970816:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191744.250499:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191744.250605:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630970816
00000100:00100000:2.0:1776191744.250652:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3437
00000100:00100000:2.0:1776191744.250658:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5f2099 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630970816:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191744.250688:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191744.250734:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5f2099 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630970816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (236us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191744.250740:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3437
00000100:00100000:1.0:1776191744.250785:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007311be7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630970816:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191745.018357:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191745.274416:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e24a0555 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630970880:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191745.274484:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191745.274571:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630970880
00000100:00100000:0.0:1776191745.274621:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3438
00000100:00100000:0.0:1776191745.274627:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000994ca5e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630970880:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191745.274668:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191745.274724:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000994ca5e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630970880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (241us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191745.274732:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3438
00000100:00100000:2.0:1776191745.274812:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e24a0555 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630970880:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191746.043741:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1776191746.298310:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1776191746.298310:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003fb0e1f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630970944:0@lo:400:kworker/u8:4.0
00000100:00080000:0.0:1776191746.298319:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191746.298323:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191746.298328:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4279
00000100:00080000:0.0:1776191746.298332:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191746.298337:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191746.298358:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000003a0c5ca5 x1862467630971392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191746.298373:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191746.298376:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191746.298391:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191746.298395:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4279
00000100:00080000:0.0:1776191746.298397:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191746.298401:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191746.298407:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191746.298415:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000001a426c55 x1862467630971520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191746.298435:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630970944
00000100:00100000:2.0:1776191746.298436:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e24a0555 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630971200:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191746.298460:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000067cb6dcd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630971008:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191746.298467:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005c0e1db0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630971072:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191746.298468:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191746.298476:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1884
00000100:00100000:3.0:1776191746.298483:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002224990e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630970944:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191746.298495:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000150035b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630971584:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191746.298502:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191746.298502:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191746.298526:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086a13048 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630971328:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191746.298527:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630971264:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191746.298541:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002224990e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630970944:12345-0@lo:400:kworker/u8:4.0 Request processed in 57us (137us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191746.298550:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1884
00000100:00100000:0.0:1776191746.298555:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191746.298559:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d1ba4a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630971136:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191746.298576:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005fd6c919 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630971712:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191746.298594:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a0c5ca5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630971392:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191746.298607:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630971008
00000100:00100000:3.0:1776191746.298611:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630971200
00000100:00100000:1.0:1776191746.298618:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191746.298637:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a426c55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630971520:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191746.298643:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630971072
00000100:00100000:0.0:1776191746.298655:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5058
00000100:00100000:1.0:1776191746.298659:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191746.298661:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d21cd713 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630971008:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191746.298666:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3439
00000100:00100000:3.0:1776191746.298673:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000481c290f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630971200:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191746.298687:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630971328
00000100:00100000:0.0:1776191746.298699:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d21cd713 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630971008:12345-0@lo:400:kworker/u8:4.0 Request processed in 38us (198us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191746.298706:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5058
00000100:00100000:1.0:1776191746.298715:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630971392
00000100:00100000:3.0:1776191746.298723:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000481c290f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630971200:12345-0@lo:400:kworker/u8:4.0 Request processed in 49us (258us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191746.298730:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3439
00000100:00100000:1.0:1776191746.298734:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630971520
00000100:00100000:3.0:1776191746.298756:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3440
00000100:00100000:3.0:1776191746.298761:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d6387b57 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630971072:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191746.298792:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d6387b57 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630971072:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (292us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191746.298798:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3440
00000100:00100000:2.0:1776191746.298887:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191746.298919:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003fb0e1f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630970944:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191746.298932:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e24a0555 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630971200:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191746.298941:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2163
00000100:00100000:0.0:1776191746.298947:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d72c3363 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630971328:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191746.298968:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191746.298982:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d72c3363 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630971328:12345-0@lo:400:kworker/u8:4.0 Request processed in 34us (427us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191746.298989:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2163
00000100:00100000:2.0:1776191746.299000:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be4c283a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630971456:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191746.299006:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2512
00000100:00100000:0.0:1776191746.299010:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003135151f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630971392:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191746.299027:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191746.299073:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630971456
00010000:02020000:0.0:1776191746.299129:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191746.299163:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003135151f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630971392:12345-0@lo:8:kworker/u8:4.0 Request processed in 151us (546us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191746.299168:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2512
00000100:00100000:0.0:1776191746.299179:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2513
00000100:00100000:0.0:1776191746.299182:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f2c8d2dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630971520:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191746.299231:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1733
00000100:00100000:2.0:1776191746.299236:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003fb0e1f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630971456:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191746.299256:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00010000:02020000:0.0:1776191746.299262:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191746.299299:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003fb0e1f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630971456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (271us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191746.299304:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f2c8d2dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630971520:12345-0@lo:8:kworker/u8:4.0 Request processed in 117us (641us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191746.299312:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1733
00000100:00100000:0.0:1776191746.299316:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2513
00000100:00100000:0.0:1776191746.299350:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630971584
00000100:00100000:0.0:1776191746.299371:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630971136
00000100:00100000:1.0:1776191746.299394:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191746.299402:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5059
00000100:00100000:0.0:1776191746.299405:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003f01d2f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630971584:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191746.299409:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007311be7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630971648:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191746.299429:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191746.299438:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003f01d2f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630971584:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (908us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191746.299443:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5059
00000100:00100000:2.0:1776191746.299451:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630971648
00000100:00100000:1.0:1776191746.299456:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000067cb6dcd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630971008:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191746.299479:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1734
00000100:00100000:1.0:1776191746.299485:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191746.299488:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003c03fa37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630971648:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191746.299501:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191746.299515:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630971264
00000100:00100000:1.0:1776191746.299520:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005c0e1db0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630971072:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191746.299537:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086a13048 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630971328:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191746.299542:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2164
00000100:00100000:3.0:1776191746.299548:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ade5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630971264:12345-0@lo:400:kworker/u8:4.0
00000100:00080000:1.0:1776191746.299582:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191746.299585:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191746.299589:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a0c5ca5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630971392:0@lo:8:kworker/u8:4.0
00000100:00080000:1.0:1776191746.299596:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191746.299598:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191746.299600:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a426c55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630971520:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191746.299621:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630971712
00000100:00100000:1.0:1776191746.299644:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5060
00000100:00100000:1.0:1776191746.299647:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e24a0555 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630971136:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191746.299917:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5061
00000100:00100000:0.0:1776191746.299922:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa196c75 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630971712:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191746.300057:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ade5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630971264:12345-0@lo:400:kworker/u8:4.0 Request processed in 509us (663us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191746.300065:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2164
00000100:00100000:2.0:1776191746.300067:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003c03fa37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630971648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 582us (638us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191746.300072:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1734
00000100:00100000:3.0:1776191746.300126:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be4c283a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630971456:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191746.300162:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000150035b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630971584:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191746.300240:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630971264:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191746.300253:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007311be7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630971648:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191746.300496:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e24a0555 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630971136:12345-0@lo:400:kworker/u8:4.0 Request processed in 847us (1528us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191746.300504:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5060
00000100:00100000:3.0:1776191746.300510:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d1ba4a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630971136:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191746.301990:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa196c75 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630971712:12345-0@lo:400:kworker/u8:4.0 Request processed in 2062us (2502us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191746.302003:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5061
00000100:00100000:1.0:1776191746.302201:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005fd6c919 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630971712:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191747.066404:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191747.932724:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191747.932831:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191747.932866:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191747.932895:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191747.932958:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613819520
00000100:00100000:2.0:1776191747.933005:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1885
00000100:00100000:2.0:1776191747.933012:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e89cfd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613819520:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191747.933100:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e89cfd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613819520:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 88us (270us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191747.933108:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1885
00000100:00100000:3.0:1776191747.933248:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613819712
00000100:00100000:3.0:1776191747.933596:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2165
00000100:00100000:3.0:1776191747.933603:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f210a7b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613819712:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191747.933683:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f210a7b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613819712:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 80us (817us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191747.933689:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2165
00000100:00100000:0.0:1776191747.934510:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191747.934526:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613819584
00000100:00100000:2.0:1776191747.934553:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613819648
00000100:00100000:1.0:1776191747.934588:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5062
00000100:00100000:1.0:1776191747.934599:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000341b9800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613819584:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191747.934609:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5063
00000100:00100000:2.0:1776191747.934618:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000954c89ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613819648:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191747.934690:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000341b9800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613819584:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 84us (1966us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191747.934702:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5062
00000100:00100000:3.0:1776191747.934712:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613819776
00000100:00100000:3.0:1776191747.934751:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2514
00000100:00100000:3.0:1776191747.934759:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000068cadb2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613819776:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:3.0:1776191747.934870:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191747.936415:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000954c89ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613819648:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 1790us (3512us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191747.936444:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5063
00000100:00100000:3.0:1776191747.938420:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000068cadb2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613819776:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 3653us (3904us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191747.938634:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2514
00010000:00010000:0.0:1776191748.090426:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191749.115016:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191749.370206:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002599c576 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630971776:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191749.370279:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191749.370382:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630971776
00000100:00100000:1.0:1776191749.370435:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3441
00000100:00100000:1.0:1776191749.370441:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be4c283a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630971776:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191749.370480:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191749.370543:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be4c283a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630971776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (265us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191749.370559:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3441
00000100:00100000:3.0:1776191749.371175:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002599c576 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630971776:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191750.138904:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191750.394259:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1776191750.394273:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d1ba4a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630971840:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191750.394348:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191750.394444:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630971840
00000100:00100000:0.0:1776191750.394491:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3442
00000100:00100000:0.0:1776191750.394496:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006062370f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630971840:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191750.394528:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191750.394577:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006062370f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630971840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (229us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191750.394585:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3442
00000100:00100000:2.0:1776191750.394805:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d1ba4a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630971840:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191751.163172:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191751.418233:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191751.418258:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005fd6c919 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630971904:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191751.418339:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191751.418377:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fc54ddfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630971968:0@lo:400:kworker/u8:2.0
00000100:00080000:1.0:1776191751.418401:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191751.418406:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191751.418410:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1776191751.418416:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191751.418419:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4284
00000100:00080000:1.0:1776191751.418423:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191751.418429:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191751.418437:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007311be7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630972224:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191751.418448:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000008611bf7d x1862467630972352/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191751.418463:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191751.418465:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191751.418470:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191751.418472:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191751.418475:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4284
00000100:00080000:1.0:1776191751.418477:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191751.418480:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191751.418482:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191751.418489:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002599c576 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630972160:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191751.418503:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000ebe193c3 x1862467630972416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191751.418515:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191751.418534:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191751.418542:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000695c22eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630972544:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191751.418546:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008611bf7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630972352:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191751.418568:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191751.418590:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191751.418607:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630971904
00000100:00100000:1.0:1776191751.418614:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ebe193c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630972416:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191751.418638:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191751.418648:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1735
00000100:00100000:3.0:1776191751.418655:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000150035b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630971904:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191751.418670:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630972352
00002000:00000024:3.0:1776191751.418684:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191751.418693:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630972416
00000100:00100000:1.0:1776191751.418711:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2515
00000100:00100000:1.0:1776191751.418716:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a366bf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630972352:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191751.418726:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000150035b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630971904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (388us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191751.418733:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1735
00000100:00100000:3.0:1776191751.418753:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b170a27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630972096:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191751.418774:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191751.418786:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb143dd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630972480:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191751.418803:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:02020000:1.0:1776191751.418815:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191751.418819:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:3.0:1776191751.418825:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c02ea968 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630972032:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191751.418855:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191751.418860:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a366bf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630972352:12345-0@lo:8:kworker/u8:2.0 Request processed in 141us (270us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191751.418868:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2515
00000100:00100000:3.0:1776191751.418874:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d1858cc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630972288:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191751.418883:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2516
00000100:00100000:1.0:1776191751.418888:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d5419f64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630972416:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191751.418896:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191751.418924:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630971968
00000100:00100000:3.0:1776191751.418946:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1886
00000100:00100000:3.0:1776191751.418950:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f3625dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630971968:12345-0@lo:400:kworker/u8:2.0
00010000:02020000:1.0:1776191751.418972:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191751.418980:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f3625dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630971968:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (567us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191751.418986:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1886
00000100:00100000:3.0:1776191751.419017:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630972160
00000100:00100000:1.0:1776191751.419019:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d5419f64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630972416:12345-0@lo:8:kworker/u8:2.0 Request processed in 130us (380us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191751.419028:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2516
00000100:00100000:3.0:1776191751.419064:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630972544
00000100:00100000:1.0:1776191751.419070:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630972288
00000100:00100000:3.0:1776191751.419087:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630972480
00000100:00100000:1.0:1776191751.419102:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2166
00000100:00100000:1.0:1776191751.419107:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004da0b0e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630972288:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191751.419110:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630972032
00000100:00100000:3.0:1776191751.419131:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5064
00000100:00100000:3.0:1776191751.419135:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c5289760 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630972160:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191751.419147:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004da0b0e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630972288:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (250us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191751.419155:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2166
00000100:00100000:3.0:1776191751.419172:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c5289760 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630972160:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (657us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191751.419182:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5064
00000100:00100000:3.0:1776191751.419196:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5065
00000100:00100000:3.0:1776191751.419200:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000015a1beae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630972544:12345-0@lo:400:kworker/u8:2.0
00000100:00080000:1.0:1776191751.419202:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191751.419207:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191751.419211:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008611bf7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630972352:0@lo:8:kworker/u8:2.0
00000100:00080000:1.0:1776191751.419224:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191751.419227:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191751.419230:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000015a1beae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630972544:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (661us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191751.419233:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ebe193c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630972416:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191751.419242:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5065
00000100:00100000:3.0:1776191751.419255:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5066
00000100:00100000:3.0:1776191751.419259:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4e82865 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630972480:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191751.419296:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5067
00000100:00100000:3.0:1776191751.419300:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4e82865 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630972480:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (496us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191751.419304:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000690142e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630972032:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191751.419310:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5066
00000100:00100000:1.0:1776191751.419343:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000690142e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630972032:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (488us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191751.419349:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5067
00000100:00100000:3.0:1776191751.419353:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c02ea968 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630972032:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191751.419367:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d1858cc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630972288:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191751.419377:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb143dd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630972480:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191751.419379:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630972224
00000100:00100000:1.0:1776191751.419410:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630972096
00000100:00100000:3.0:1776191751.419417:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3443
00000100:00100000:3.0:1776191751.419422:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000182c146b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630972224:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191751.419531:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776191751.419539:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d1ba4a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630972608:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191751.419566:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191751.419594:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3444
00000100:00100000:2.0:1776191751.419595:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630972608
00000100:00100000:1.0:1776191751.419601:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1bce22f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630972096:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191751.419623:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1736
00000100:00100000:2.0:1776191751.419629:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c0e1db0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630972608:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191751.419640:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191751.419646:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1bce22f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630972096:12345-0@lo:400:kworker/u8:2.0 Request processed in 44us (870us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191751.419653:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3444
00000100:00100000:2.0:1776191751.419683:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c0e1db0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630972608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (116us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191751.419686:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b170a27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630972096:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191751.419695:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1736
00000100:00100000:1.0:1776191751.419720:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000695c22eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630972544:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191751.419735:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d1ba4a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630972608:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191751.419737:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002599c576 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630972160:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191751.419753:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc54ddfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630971968:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191751.419770:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005fd6c919 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630971904:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191751.420897:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000182c146b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630972224:12345-0@lo:400:kworker/u8:2.0 Request processed in 1473us (2433us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191751.420907:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3443
00000100:00100000:1.0:1776191751.421768:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007311be7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630972224:0@lo:400:kworker/u8:2.0
00010000:00010000:3.0:1776191752.186331:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191753.051649:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191753.051702:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191753.051737:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191753.051768:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191753.051788:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191753.051868:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613819840
00000100:00100000:3.0:1776191753.051926:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1887
00000100:00100000:3.0:1776191753.051933:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e270043d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613819840:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191753.052005:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e270043d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613819840:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 72us (303us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191753.052012:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1887
00000100:00100000:1.0:1776191753.052174:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613819968
00000100:00100000:1.0:1776191753.052215:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613819904
00000100:00100000:1.0:1776191753.052249:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5068
00000100:00100000:1.0:1776191753.052254:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c1011c34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613819968:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191753.052331:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613820096
00000100:00100000:2.0:1776191753.052356:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613820032
00000100:00100000:2.0:1776191753.052383:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2167
00000100:00100000:2.0:1776191753.052388:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009eabfd74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613820032:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191753.052394:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5069
00000100:00100000:3.0:1776191753.052401:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e80ba0d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613819904:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191753.052987:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c1011c34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613819968:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 729us (1247us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191753.052996:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5068
00000100:00100000:1.0:1776191753.053025:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2517
00000100:00100000:1.0:1776191753.053030:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000603b89b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613820096:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:1.0:1776191753.053276:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191753.053306:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000603b89b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613820096:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 275us (1666us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191753.053313:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2517
00000100:00100000:2.0:1776191753.068593:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009eabfd74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613820032:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 16194us (16794us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191753.068614:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2167
00000100:00100000:3.0:1776191753.070958:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e80ba0d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613819904:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 18549us (19182us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191753.070975:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5069
00010000:00010000:3.0:1776191753.210295:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191754.236803:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191754.490638:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1776191754.490661:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007311be7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630972672:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191754.490736:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191754.490987:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630972672
00000100:00100000:0.0:1776191754.491081:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3445
00000100:00100000:0.0:1776191754.491087:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb97b35c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630972672:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191754.491125:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191754.491181:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb97b35c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630972672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (446us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191754.491300:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007311be7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630972672:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191754.491346:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3445
00010000:00010000:3.0:1776191755.258484:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191755.514451:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d1ba4a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630972736:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191755.514529:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191755.515425:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630972736
00000100:00100000:3.0:1776191755.515484:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3446
00000100:00100000:3.0:1776191755.515489:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b8ca4c1a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630972736:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191755.515523:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191755.515586:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b8ca4c1a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630972736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (1057us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191755.515593:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3446
00000100:00100000:0.0:1776191755.515694:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d1ba4a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630972736:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191756.283821:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191756.538203:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000067cb6dcd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630972800:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191756.538220:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fc54ddfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630972864:0@lo:400:kworker/u8:2.0
00000100:00080000:1.0:1776191756.538266:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191756.538273:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191756.538277:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1776191756.538278:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191756.538279:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191756.538286:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4289
00000100:00080000:1.0:1776191756.538290:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191756.538297:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191756.538317:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000dc54e5ba x1862467630973312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191756.538334:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191756.538337:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191756.538339:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191756.538343:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4289
00000100:00080000:1.0:1776191756.538344:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191756.538348:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191756.538357:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000188ce8c6 x1862467630973376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191756.538400:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000695c22eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630972992:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191756.538434:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630972864
00000100:00100000:3.0:1776191756.538476:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1888
00000100:00100000:3.0:1776191756.538481:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fecbd6f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630972864:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191756.539057:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ebe193c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630973120:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191756.539090:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191756.539109:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007311be7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630973504:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191756.539132:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191756.539148:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:2.0:1776191756.539154:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b170a27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630973056:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191756.541998:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191756.542053:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002599c576 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630972928:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191756.542058:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003fc60884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630973440:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191756.542095:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191756.542123:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008611bf7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630973184:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191756.542143:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191756.542155:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191756.542184:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0c75a22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630973248:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191756.542192:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000009501226 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630973568:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191756.542222:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191756.542230:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191756.542252:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fecbd6f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630972864:12345-0@lo:400:kworker/u8:2.0 Request processed in 3767us (3976us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191756.542259:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc54e5ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630973312:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191756.542265:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1888
00000100:00100000:1.0:1776191756.542282:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191756.542296:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630973376:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191756.542313:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191756.542315:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630972800
00000100:00100000:1.0:1776191756.542336:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630973184
00000100:00100000:3.0:1776191756.542344:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630973568
00000100:00100000:1.0:1776191756.542356:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630973248
00000100:00100000:3.0:1776191756.542357:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1737
00000100:00100000:1.0:1776191756.542368:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630973312
00000100:00100000:1.0:1776191756.542377:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630973376
00000100:00100000:1.0:1776191756.542385:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2168
00000100:00100000:3.0:1776191756.542385:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af44226e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630972800:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191756.542388:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049908ee0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630973184:12345-0@lo:400:kworker/u8:2.0
00002000:00000024:3.0:1776191756.542413:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191756.542430:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049908ee0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630973184:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (276us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191756.542435:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2168
00000100:00100000:1.0:1776191756.542448:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2169
00000100:00100000:1.0:1776191756.542451:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d1858cc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3366:x1862467630973248:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191756.542455:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af44226e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630972800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (4183us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191756.542461:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1737
00000100:00100000:3.0:1776191756.542471:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1738
00000100:00100000:3.0:1776191756.542475:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000365abfb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3365:x1862467630973568:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191756.542476:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d1858cc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3366:x1862467630973248:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (261us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191756.542481:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2169
00002000:00000024:3.0:1776191756.542483:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191756.542490:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2518
00000100:00100000:1.0:1776191756.542493:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c02ea968 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630973312:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191756.542502:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000365abfb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630973568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 27us (274us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191756.542507:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1738
00000100:00100000:3.0:1776191756.542522:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630973120
00000100:00100000:3.0:1776191756.542534:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630972992
00000100:00100000:3.0:1776191756.542558:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3447
00000100:00100000:3.0:1776191756.542562:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d1ba4a82 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630973120:12345-0@lo:400:kworker/u8:2.0
00010000:02020000:1.0:1776191756.542598:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191756.542603:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d1ba4a82 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630973120:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (3505us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191756.542612:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3447
00000100:00100000:1.0:1776191756.542627:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c02ea968 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630973312:12345-0@lo:8:kworker/u8:2.0 Request processed in 132us (344us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191756.542636:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2518
00000100:00100000:2.0:1776191756.542640:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630973504
00000100:00100000:1.0:1776191756.542645:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2519
00000100:00100000:3.0:1776191756.542645:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3448
00000100:00100000:1.0:1776191756.542649:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005fd6c919 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630973376:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191756.542649:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb143dd0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630972992:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191756.542678:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630973056
00000100:00100000:3.0:1776191756.542680:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb143dd0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630972992:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (539us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191756.542697:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3448
00000100:00100000:2.0:1776191756.542702:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630972928
00000100:00100000:2.0:1776191756.542728:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5070
00010000:02020000:1.0:1776191756.542730:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191756.542734:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5071
00000100:00100000:2.0:1776191756.542737:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d2db40d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630973504:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191756.542743:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002fc9e52b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630973056:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191756.542757:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005fd6c919 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630973376:12345-0@lo:8:kworker/u8:2.0 Request processed in 107us (444us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191756.542766:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2519
00000100:00100000:0.0:1776191756.542773:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5072
00000100:00100000:0.0:1776191756.542782:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001105f678 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630972928:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191756.542800:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d2db40d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630973504:12345-0@lo:400:kworker/u8:2.0 Request processed in 62us (3665us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191756.542801:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002fc9e52b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630973056:12345-0@lo:400:kworker/u8:2.0 Request processed in 58us (804us total) trans 0 rc 0/0
00000100:00080000:1.0:1776191756.542811:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1776191756.542812:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5071
00000100:00080000:1.0:1776191756.542814:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191756.542818:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc54e5ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630973312:0@lo:8:kworker/u8:2.0
00000100:00080000:1.0:1776191756.542828:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191756.542830:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191756.542832:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630973376:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191756.542858:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000695c22eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630972992:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191756.542859:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191756.542867:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0c75a22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630973248:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191756.542895:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002599c576 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630972928:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191756.542903:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008611bf7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630973184:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191756.542913:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000009501226 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630973568:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191756.542942:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000067cb6dcd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630972800:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191756.542957:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001105f678 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630972928:12345-0@lo:400:kworker/u8:2.0 Request processed in 175us (861us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191756.542966:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5072
00000100:00100000:1.0:1776191756.542968:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630973440
00000100:00100000:3.0:1776191756.542970:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ebe193c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630973120:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191756.542983:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007311be7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630973504:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191756.542993:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fc54ddfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630972864:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191756.543076:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5073
00000100:00100000:3.0:1776191756.543076:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b170a27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630973056:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191756.543080:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000cc4c333 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630973440:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191756.543142:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5070
00000100:00100000:1.0:1776191756.543192:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000cc4c333 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630973440:12345-0@lo:400:kworker/u8:2.0 Request processed in 110us (332us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191756.543193:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003fc60884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630973440:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191756.543199:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5073
00010000:00010000:0.0:1776191757.308215:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191758.175935:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191758.175980:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191758.176194:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613820224
00000100:00100000:3.0:1776191758.176250:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5074
00000100:00100000:3.0:1776191758.176256:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d908df0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613820224:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191758.176324:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d908df0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613820224:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 68us (344us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191758.176331:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5074
00000100:00100000:1.0:1776191758.176820:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613820160
00000100:00100000:1.0:1776191758.176862:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1889
00000100:00100000:1.0:1776191758.176867:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f7ed2aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613820160:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191758.176910:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f7ed2aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613820160:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 42us (980us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191758.176916:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1889
00000100:00100000:0.0:1776191758.196595:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191758.196640:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191758.196677:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191758.196845:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613820352
00000100:00100000:2.0:1776191758.196893:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613820416
00000100:00100000:2.0:1776191758.196922:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2170
00000100:00100000:2.0:1776191758.196929:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af393e55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613820352:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191758.196998:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af393e55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613820352:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 69us (410us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191758.197014:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2170
00000100:00100000:2.0:1776191758.197070:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2520
00000100:00100000:2.0:1776191758.197075:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000640b7818 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613820416:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:2.0:1776191758.197182:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191758.197208:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000640b7818 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613820416:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 132us (531us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191758.197214:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2520
00000100:00100000:1.0:1776191758.198467:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613820288
00000100:00100000:1.0:1776191758.198528:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5075
00000100:00100000:1.0:1776191758.198534:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e555734e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613820288:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191758.198607:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e555734e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613820288:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 64us (1957us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191758.198615:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5075
00010000:00010000:3.0:1776191758.330620:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191759.356995:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191759.610937:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191759.610959:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000067cb6dcd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630973632:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191759.611027:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191759.611331:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630973632
00000100:00100000:3.0:1776191759.611384:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3449
00000100:00100000:3.0:1776191759.611390:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f74cc947 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630973632:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191759.611422:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191759.611471:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f74cc947 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630973632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (444us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191759.611478:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3449
00000100:00100000:1.0:1776191759.613707:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000067cb6dcd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630973632:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191760.378276:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191760.637064:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cd188b2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630973696:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191760.637154:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191760.637270:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630973696
00000100:00100000:3.0:1776191760.637323:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3450
00000100:00100000:3.0:1776191760.637329:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000067cb6dcd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630973696:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191760.637359:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191760.637406:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000067cb6dcd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630973696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (254us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191760.637414:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3450
00000100:00100000:1.0:1776191760.637601:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cd188b2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630973696:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191761.403399:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1776191761.658659:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191761.658670:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191761.658682:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1776191761.658688:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009916a1d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630973952:0@lo:400:kworker/u8:4.0
00000100:00080000:0.0:1776191761.658690:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4294
00000100:00080000:0.0:1776191761.658695:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191761.658701:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191761.658725:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000009c02746a x1862467630974208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191761.658742:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191761.658745:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191761.658746:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191761.658749:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4294
00000100:00080000:0.0:1776191761.658751:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191761.658755:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191761.658760:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191761.658770:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000ec42a12f x1862467630974272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191761.658796:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009df06d88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630974336:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191761.658820:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007756d7ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630973824:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191761.658825:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191761.658846:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [1->0]
00000100:00100000:1.0:1776191761.658852:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000016dc0009 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630973760:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191761.658858:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191761.658881:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085501c10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630974080:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191761.658890:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191761.658911:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030c9704c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630974016:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191761.658935:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191761.658939:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191761.658961:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000418a6d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630974400:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191761.658964:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:0.0:1776191761.658972:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d0c84519 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630973888:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191761.658986:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191761.659000:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191761.659017:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea373370 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630974144:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191761.659019:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c02746a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630974208:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191761.659079:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191761.659094:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630974272:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191761.659122:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191761.659153:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630973952
00000100:00100000:1.0:1776191761.659191:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630974336
00000100:00100000:1.0:1776191761.659211:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630973824
00000100:00100000:1.0:1776191761.659224:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630974400
00000100:00100000:1.0:1776191761.659238:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5076
00000100:00100000:1.0:1776191761.659244:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003fc60884 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630973952:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191761.659300:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003fc60884 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630973952:12345-0@lo:400:kworker/u8:4.0 Request processed in 53us (542us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191761.659304:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191761.659311:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5076
00000100:00100000:1.0:1776191761.659332:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5077
00000100:00100000:1.0:1776191761.659338:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002b170a27 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630974336:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191761.659345:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5078
00000100:00100000:0.0:1776191761.659351:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009189961c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630973824:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191761.659367:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002b170a27 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630974336:12345-0@lo:400:kworker/u8:4.0 Request processed in 29us (544us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191761.659376:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5077
00000100:00100000:1.0:1776191761.659391:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5079
00000100:00100000:0.0:1776191761.659398:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009189961c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630973824:12345-0@lo:400:kworker/u8:4.0 Request processed in 45us (539us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191761.659398:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007311be7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630974400:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191761.659411:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5078
00000100:00100000:1.0:1776191761.659433:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007311be7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630974400:12345-0@lo:400:kworker/u8:4.0 Request processed in 36us (447us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191761.659440:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5079
00000100:00100000:0.0:1776191761.659442:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630974080
00000100:00100000:0.0:1776191761.659471:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630974208
00000100:00100000:1.0:1776191761.659479:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000418a6d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630974400:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191761.659488:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630974272
00000100:00100000:1.0:1776191761.659493:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009df06d88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630974336:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191761.659500:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630974144
00000100:00100000:1.0:1776191761.659505:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009916a1d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630973952:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191761.659519:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2171
00000100:00100000:0.0:1776191761.659525:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b2d11c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630974080:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191761.659542:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2172
00000100:00100000:1.0:1776191761.659548:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c251e98f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630974144:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191761.659558:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b2d11c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630974080:12345-0@lo:400:kworker/u8:4.0 Request processed in 32us (623us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191761.659565:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2171
00000100:00100000:0.0:1776191761.659580:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2521
00000100:00100000:0.0:1776191761.659587:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ebe193c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630974208:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191761.659587:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c251e98f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630974144:12345-0@lo:400:kworker/u8:4.0 Request processed in 36us (287us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191761.659599:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2172
00000100:00100000:1.0:1776191761.659615:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2522
00000100:00100000:1.0:1776191761.659618:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008611bf7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630974272:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191761.659742:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191761.659773:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008611bf7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630974272:12345-0@lo:8:kworker/u8:4.0 Request processed in 154us (651us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191761.659778:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2522
00000100:00080000:1.0:1776191761.659802:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191761.659805:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191761.659809:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630974272:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191761.659856:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea373370 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630974144:0@lo:400:kworker/u8:4.0
00010000:02020000:0.0:1776191761.659864:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191761.659867:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007756d7ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630973824:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191761.659878:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085501c10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630974080:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191761.659905:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ebe193c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630974208:12345-0@lo:8:kworker/u8:4.0 Request processed in 318us (825us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191761.659913:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2521
00000100:00080000:1.0:1776191761.659921:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191761.659925:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191761.659928:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c02746a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630974208:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191761.661471:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630974016
00000100:00100000:2.0:1776191761.661515:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630973888
00000100:00100000:2.0:1776191761.661529:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3451
00000100:00100000:2.0:1776191761.661535:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fc54ddfd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630974016:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191761.661595:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fc54ddfd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630974016:12345-0@lo:400:kworker/u8:4.0 Request processed in 60us (2659us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191761.661602:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3451
00000100:00100000:2.0:1776191761.661617:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3452
00000100:00100000:2.0:1776191761.661621:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1fe5010 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630973888:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191761.661645:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1fe5010 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630973888:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (2647us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191761.661650:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3452
00000100:00100000:2.0:1776191761.661664:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1776191761.661674:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000023fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630974464:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191761.661706:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191761.661738:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630974464
00000100:00100000:2.0:1776191761.661759:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1739
00000100:00100000:2.0:1776191761.661763:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a133ee9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630974464:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191761.661782:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191761.661810:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a133ee9d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630974464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (105us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191761.661815:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1739
00000100:00100000:2.0:1776191761.661843:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000023fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630974464:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191761.661883:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030c9704c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630974016:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191761.663619:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630973760
00000100:00100000:3.0:1776191761.663662:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1890
00000100:00100000:3.0:1776191761.663667:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000328cc67f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630973760:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191761.663724:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000328cc67f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630973760:12345-0@lo:400:kworker/u8:4.0 Request processed in 57us (4834us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191761.663730:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1890
00000100:00100000:2.0:1776191761.664089:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000090a9e988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630974528:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191761.664122:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191761.664180:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0c84519 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630973888:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191761.664184:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000016dc0009 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630973760:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191761.664378:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630974528
00000100:00100000:3.0:1776191761.664414:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1740
00000100:00100000:3.0:1776191761.664418:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000023fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630974528:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191761.664433:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191761.664472:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000023fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630974528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (350us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191761.664478:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1740
00000100:00100000:0.0:1776191761.664537:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000090a9e988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630974528:0@lo:13:osp-pre-0-0.0
00010000:00010000:3.0:1776191762.426501:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191763.292103:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191763.292150:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191763.292182:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191763.292222:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191763.292268:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613820480
00000100:00100000:3.0:1776191763.292301:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613820672
00000100:00100000:1.0:1776191763.292328:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1891
00000100:00100000:1.0:1776191763.292336:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019aa1469 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613820480:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191763.292339:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2173
00000100:00100000:3.0:1776191763.292347:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f9388e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613820672:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191763.292458:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613820544
00000100:00100000:2.0:1776191763.292475:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613820608
00000100:00100000:0.0:1776191763.292496:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5080
00000100:00100000:0.0:1776191763.292501:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d3e82d65 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613820544:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191763.292600:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f9388e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613820672:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 252us (450us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191763.292609:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2173
00000100:00100000:1.0:1776191763.292623:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019aa1469 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613820480:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 285us (438us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191763.292633:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1891
00000100:00100000:0.0:1776191763.292712:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d3e82d65 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613820544:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 210us (617us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191763.292720:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5080
00000100:00100000:2.0:1776191763.292777:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5081
00000100:00100000:2.0:1776191763.292782:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c119b61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613820608:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191763.292814:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c119b61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613820608:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 31us (592us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191763.292819:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5081
00000100:00100000:2.0:1776191763.294256:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191763.294701:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613820736
00000100:00100000:3.0:1776191763.294742:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2523
00000100:00100000:3.0:1776191763.294748:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005783e1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613820736:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:3.0:1776191763.294847:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191763.294904:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005783e1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613820736:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 156us (654us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191763.294912:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2523
00010000:00010000:0.0:1776191763.452393:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191764.475087:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191764.733513:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191764.733536:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002599c576 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630974592:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191764.733603:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191764.733726:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630974592
00000100:00100000:1.0:1776191764.733775:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3453
00000100:00100000:1.0:1776191764.733781:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000044860d59 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630974592:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191764.733812:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191764.733871:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000044860d59 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630974592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (268us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191764.733879:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3453
00000100:00100000:3.0:1776191764.735105:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002599c576 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630974592:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191765.500348:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191765.755326:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cd188b2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630974656:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191765.755396:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191765.755578:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630974656
00000100:00100000:1.0:1776191765.755695:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3454
00000100:00100000:1.0:1776191765.755702:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090a9e988 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630974656:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191765.755734:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191765.755784:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090a9e988 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630974656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (388us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191765.755790:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3454
00000100:00100000:0.0:1776191765.755901:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cd188b2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630974656:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191766.522348:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191766.778579:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191766.778601:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cd188b2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630974720:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191766.778663:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1776191766.778850:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191766.778854:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191766.778857:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191766.778861:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4299
00000100:00080000:2.0:1776191766.778864:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191766.778869:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191766.778887:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000002ec7cac8 x1862467630975168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191766.778901:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191766.778904:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191766.778905:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191766.778908:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4299
00000100:00080000:2.0:1776191766.778910:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191766.778912:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191766.778921:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000006ff6c3c2 x1862467630975232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191766.778969:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630974720
00000100:00100000:2.0:1776191766.779019:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1741
00000100:00100000:2.0:1776191766.779024:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fca68564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630974720:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191766.779070:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191766.779105:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fca68564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630974720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (443us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191766.779112:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1741
00000100:00100000:2.0:1776191766.779135:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000819bd127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630974848:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191766.779160:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191766.779175:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb4cf93d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630975104:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191766.779194:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191766.779208:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:2.0:1776191766.779213:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ff9f217e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630974912:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191766.779236:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191766.779247:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006821defb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630975296:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191766.779264:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191766.779289:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630974848
00000100:00100000:2.0:1776191766.779314:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630975296
00000100:00100000:2.0:1776191766.779328:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5082
00000100:00100000:2.0:1776191766.779332:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001dcb8edb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630974848:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191766.779365:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001dcb8edb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630974848:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (205us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191766.779371:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5082
00000100:00100000:2.0:1776191766.779383:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5083
00000100:00100000:2.0:1776191766.779387:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000290b34e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630975296:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191766.779409:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000290b34e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630975296:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (144us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191766.779414:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5083
00000100:00100000:2.0:1776191766.779431:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630975104
00000100:00100000:2.0:1776191766.779448:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2174
00000100:00100000:2.0:1776191766.779451:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd341e03 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630975104:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191766.779474:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd341e03 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630975104:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (279us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191766.779481:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2174
00000100:00100000:2.0:1776191766.779517:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006821defb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630975296:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191766.779527:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000819bd127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630974848:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191766.779534:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb4cf93d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630975104:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191766.779803:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630974912
00000100:00100000:3.0:1776191766.779840:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3455
00000100:00100000:3.0:1776191766.779844:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001f598cfd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630974912:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191766.779883:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001f598cfd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630974912:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (646us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191766.779888:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3455
00000100:00100000:3.0:1776191766.779914:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ff9f217e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630974912:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191766.780110:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000138721a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630974784:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191766.780143:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191766.780166:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004faaa807 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630975040:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191766.780184:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191766.780198:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000009501226 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630975424:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191766.780216:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191766.780241:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cd188b2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630974720:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191766.780254:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:0.0:1776191766.780258:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfc0fcff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630974976:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191766.780277:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191766.780289:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005f9ce4ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630975360:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191766.780307:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191766.780329:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630974976
00000100:00100000:0.0:1776191766.780351:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630975360
00000100:00100000:0.0:1776191766.780365:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5084
00000100:00100000:0.0:1776191766.780369:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003554eb98 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630974976:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191766.780400:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003554eb98 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630974976:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (123us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191766.780406:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5084
00000100:00100000:0.0:1776191766.780417:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5085
00000100:00100000:0.0:1776191766.780420:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006db887d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630975360:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191766.780442:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006db887d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630975360:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (135us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191766.780447:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5085
00000100:00100000:0.0:1776191766.780464:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630975424
00000100:00100000:0.0:1776191766.780483:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1742
00000100:00100000:0.0:1776191766.780486:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007759fe0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630975424:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191766.780496:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191766.780519:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007759fe0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630975424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 32us (302us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191766.780523:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1742
00000100:00100000:0.0:1776191766.780537:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630975040
00000100:00100000:0.0:1776191766.780554:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3456
00000100:00100000:0.0:1776191766.780557:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c719287 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630975040:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191766.780579:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c719287 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630975040:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (394us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191766.780584:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3456
00000100:00100000:0.0:1776191766.780612:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfc0fcff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630974976:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191766.780620:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005f9ce4ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630975360:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191766.780627:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004faaa807 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630975040:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191766.780638:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000009501226 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630975424:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191766.780709:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630974784
00000100:00100000:3.0:1776191766.780736:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1892
00000100:00100000:3.0:1776191766.780740:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe981ad6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630974784:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191766.780772:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe981ad6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630974784:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (629us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191766.780778:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1892
00000100:00100000:3.0:1776191766.780806:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000138721a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630974784:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191766.783315:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002ec7cac8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630975168:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191766.783384:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191766.783428:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ff6c3c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630975232:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191766.783450:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191766.783645:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630975168
00000100:00100000:2.0:1776191766.783673:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630975232
00000100:00100000:2.0:1776191766.783702:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2524
00000100:00100000:2.0:1776191766.783707:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0c75a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630975168:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191766.783799:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191766.783844:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0c75a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630975168:12345-0@lo:8:kworker/u8:2.0 Request processed in 136us (460us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191766.783851:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2524
00000100:00100000:2.0:1776191766.783867:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2525
00000100:00100000:2.0:1776191766.783869:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000695c22eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630975232:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191766.783957:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191766.784108:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000695c22eb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630975232:12345-0@lo:8:kworker/u8:2.0 Request processed in 237us (657us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191766.784115:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2525
00000100:00080000:1.0:1776191766.788195:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191766.788206:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191766.788214:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002ec7cac8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630975168:0@lo:8:kworker/u8:2.0
00000100:00080000:1.0:1776191766.788227:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191766.788229:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191766.788232:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ff6c3c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630975232:0@lo:8:kworker/u8:2.0
00010000:00010000:3.0:1776191767.546302:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191768.411821:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191768.411889:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191768.411983:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191768.412023:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191768.412131:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613820800
00000100:00100000:2.0:1776191768.412181:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1893
00000100:00100000:2.0:1776191768.412187:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001479089e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613820800:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191768.412252:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001479089e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613820800:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 64us (269us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191768.412260:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1893
00000100:00100000:1.0:1776191768.412507:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613820864
00000100:00100000:1.0:1776191768.412547:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613820928
00000100:00100000:1.0:1776191768.412570:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5086
00000100:00100000:1.0:1776191768.412574:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009501226 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613820864:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191768.412612:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009501226 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613820864:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 36us (799us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191768.412619:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5086
00000100:00100000:1.0:1776191768.412640:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5087
00000100:00100000:1.0:1776191768.412645:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001ab68509 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613820928:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191768.412670:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001ab68509 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613820928:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 24us (647us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191768.412675:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5087
00000100:00100000:2.0:1776191768.413457:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191768.417174:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613820992
00000100:00100000:3.0:1776191768.419636:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613821056
00000100:00100000:3.0:1776191768.419782:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2526
00000100:00100000:3.0:1776191768.419790:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ed071c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613821056:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:3.0:1776191768.419890:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191768.420104:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2175
00000100:00100000:1.0:1776191768.420110:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000040035503 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613820992:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191768.420318:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ed071c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613821056:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 528us (6863us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191768.420331:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2526
00000100:00100000:1.0:1776191768.420387:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000040035503 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613820992:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 275us (8497us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191768.420395:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2175
00010000:00010000:3.0:1776191768.570299:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191769.594578:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191769.851190:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1776191769.851206:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003135151f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630975488:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191769.851271:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191769.851950:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630975488
00000100:00100000:1.0:1776191769.852005:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3457
00000100:00100000:1.0:1776191769.852010:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb4cf93d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630975488:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191769.852081:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191769.852133:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb4cf93d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630975488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (863us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191769.852140:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3457
00000100:00100000:2.0:1776191769.852278:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003135151f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630975488:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191770.618498:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191770.875992:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191770.876028:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000819bd127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630975552:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191770.876130:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191770.877161:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630975552
00000100:00100000:2.0:1776191770.877216:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3458
00000100:00100000:2.0:1776191770.877222:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d799a936 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630975552:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191770.877256:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191770.877322:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d799a936 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630975552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (1193us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191770.877539:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000819bd127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630975552:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191770.877587:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3458
00010000:00010000:3.0:1776191771.642271:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1776191771.898357:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191771.898364:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191771.898367:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191771.898375:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4304
00000100:00080000:1.0:1776191771.898378:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191771.898383:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191771.898401:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000ebe193c3 x1862467630976064/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191771.898405:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007a366bf6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630975744:0@lo:400:kworker/u8:2.0
00000100:00080000:1.0:1776191771.898433:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191771.898438:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191771.898439:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191771.898443:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4304
00000100:00080000:1.0:1776191771.898445:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191771.898448:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191771.898461:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000c0c75a22 x1862467630976128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191771.898483:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191771.898512:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ebe193c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630976064:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191771.898513:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008611bf7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630976000:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191771.898556:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191771.898575:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191771.898576:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0c75a22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630976128:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191771.898604:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191771.898622:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:2.0:1776191771.898630:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d5419f64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630975808:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191771.898641:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630976064
00000100:00100000:2.0:1776191771.898659:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191771.898668:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630976000
00000100:00100000:2.0:1776191771.898677:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000695c22eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630976192:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191771.898698:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630976128
00000100:00100000:2.0:1776191771.898711:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191771.898732:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2176
00000100:00100000:1.0:1776191771.898739:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004feb6fa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630976000:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191771.898745:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630975808
00000100:00100000:2.0:1776191771.898775:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630976192
00000100:00100000:1.0:1776191771.898796:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004feb6fa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630976000:12345-0@lo:400:kworker/u8:2.0 Request processed in 56us (222us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191771.898803:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5088
00000100:00100000:1.0:1776191771.898807:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2176
00000100:00100000:2.0:1776191771.898818:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e8375317 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630975808:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191771.898838:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2527
00000100:00100000:1.0:1776191771.898842:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc54e5ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630976064:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191771.898864:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e8375317 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630975808:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (206us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191771.898871:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5088
00000100:00100000:2.0:1776191771.898885:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5089
00000100:00100000:2.0:1776191771.898889:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f3989c1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630976192:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191771.898910:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f3989c1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630976192:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (212us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191771.898915:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5089
00000100:00100000:2.0:1776191771.898939:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630975744
00000100:00100000:2.0:1776191771.898960:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3459
00000100:00100000:2.0:1776191771.898964:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006821defb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630975744:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191771.898988:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006821defb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630975744:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (508us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191771.898993:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3459
00000100:00100000:2.0:1776191771.899051:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d5419f64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630975808:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191771.899073:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000695c22eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630976192:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191771.899082:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007a366bf6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630975744:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191771.899090:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008611bf7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630976000:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191771.899129:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2528
00000100:00100000:2.0:1776191771.899132:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003135151f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630976128:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191771.899219:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191771.899251:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003135151f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630976128:12345-0@lo:8:kworker/u8:2.0 Request processed in 117us (648us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191771.899257:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2528
00000100:00080000:2.0:1776191771.899279:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191771.899283:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191771.899285:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0c75a22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630976128:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191771.899813:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2c8d2dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630975616:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191771.899861:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191771.899877:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d1858cc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630975872:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191771.899911:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191771.899924:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630976256:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191771.899941:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191771.899955:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:0.0:1776191771.899960:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ade5f5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630975680:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191771.899978:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191771.899989:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c02ea968 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630975936:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191771.900004:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191771.900030:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630975936
00000100:00100000:0.0:1776191771.900071:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2177
00000100:00100000:0.0:1776191771.900075:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000088385c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630975936:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191771.900122:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000088385c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630975936:12345-0@lo:400:kworker/u8:2.0 Request processed in 46us (118us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191771.900129:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2177
00000100:00100000:0.0:1776191771.900178:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630976256
00000100:00100000:0.0:1776191771.900195:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630975680
00000100:00100000:0.0:1776191771.900208:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5090
00000100:00100000:0.0:1776191771.900212:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ee7dc10 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630976256:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191771.900237:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ee7dc10 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630976256:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (296us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191771.900242:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5090
00000100:00100000:0.0:1776191771.900252:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5091
00000100:00100000:0.0:1776191771.900256:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000783aa28e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630975680:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191771.900275:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000783aa28e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630975680:12345-0@lo:400:kworker/u8:2.0 Request processed in 19us (297us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191771.900280:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5091
00000100:00100000:0.0:1776191771.900296:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630975872
00010000:02020000:1.0:1776191771.900299:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191771.900316:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3460
00000100:00100000:0.0:1776191771.900324:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d335ff71 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630975872:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191771.900341:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc54e5ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630976064:12345-0@lo:8:kworker/u8:2.0 Request processed in 1496us (1784us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191771.900349:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2527
00000100:00100000:0.0:1776191771.900357:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d335ff71 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630975872:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (444us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191771.900364:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3460
00000100:00080000:1.0:1776191771.900381:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191771.900385:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191771.900389:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ebe193c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630976064:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191771.900409:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ade5f5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630975680:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191771.900422:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c02ea968 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630975936:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191771.900430:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d1858cc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630975872:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191771.900437:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630976256:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191771.900452:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191771.900458:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5a67c63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630976320:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191771.900492:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191771.901339:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630975616
00000100:00100000:3.0:1776191771.901386:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1894
00000100:00100000:3.0:1776191771.901390:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fc1666bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630975616:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191771.901991:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fc1666bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630975616:12345-0@lo:400:kworker/u8:2.0 Request processed in 599us (2129us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191771.902010:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1894
00000100:00100000:1.0:1776191771.902025:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2c8d2dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630975616:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191771.902148:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630976320
00000100:00100000:2.0:1776191771.902280:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1776191771.902291:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a25bb0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630976384:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191771.902331:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191771.908344:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630976384
00000100:00100000:3.0:1776191771.908396:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1743
00000100:00100000:3.0:1776191771.908401:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000013d8b4cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630976320:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191771.908433:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191771.908497:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000013d8b4cd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630976320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (8007us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191771.908504:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1743
00000100:00100000:3.0:1776191771.908529:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1744
00000100:00100000:3.0:1776191771.908532:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008ef4d77e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630976384:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191771.908546:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191771.908570:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008ef4d77e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630976384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (6240us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191771.908575:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1744
00000100:00100000:3.0:1776191771.908756:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5a67c63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630976320:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191771.910097:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a25bb0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630976384:0@lo:13:osp-pre-0-0.0
00010000:00010000:0.0:1776191772.667305:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191773.534859:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191773.534935:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613821120
00000100:00100000:1.0:1776191773.534985:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1895
00000100:00100000:1.0:1776191773.534993:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000280cef61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613821120:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191773.535006:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191773.535087:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000280cef61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613821120:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 94us (238us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191773.535094:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1895
00000100:00100000:3.0:1776191773.535148:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191773.548905:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191773.548949:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191773.548985:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613821312
00000100:00100000:3.0:1776191773.549030:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613821376
00000100:00100000:3.0:1776191773.549064:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2178
00000100:00100000:3.0:1776191773.549071:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000008826861 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613821312:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191773.549140:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000008826861 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613821312:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 69us (243us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191773.549147:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2178
00000100:00100000:3.0:1776191773.549163:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2529
00000100:00100000:3.0:1776191773.549166:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000017fc0dbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613821376:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:3.0:1776191773.549689:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191773.549719:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000017fc0dbf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613821376:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 551us (770us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191773.549726:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2529
00000100:00100000:2.0:1776191773.555490:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613821248
00000100:00100000:2.0:1776191773.555602:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613821184
00000100:00100000:2.0:1776191773.555639:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5092
00000100:00100000:2.0:1776191773.555645:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009592900a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613821248:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191773.555733:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009592900a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613821248:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 87us (20833us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191773.555742:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5092
00000100:00100000:2.0:1776191773.555763:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5093
00000100:00100000:2.0:1776191773.555769:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000056d339e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613821184:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191773.555803:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000056d339e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613821184:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 34us (20657us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191773.555809:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5093
00010000:00010000:3.0:1776191773.695207:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191774.714271:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191774.970987:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2c8d2dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630976448:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191774.971074:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191774.971345:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630976448
00000100:00100000:3.0:1776191774.971386:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3461
00000100:00100000:3.0:1776191774.971392:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a25bb0a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630976448:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191774.971424:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191774.971482:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a25bb0a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630976448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (408us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191774.971489:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3461
00000100:00100000:2.0:1776191774.971932:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2c8d2dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630976448:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191775.738247:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191775.994454:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1776191775.994469:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008deca8e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630976512:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191775.994552:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191775.995827:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630976512
00000100:00100000:2.0:1776191775.996206:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3462
00000100:00100000:2.0:1776191775.996215:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000635a6f18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630976512:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191775.996253:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191775.996528:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000635a6f18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630976512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 313us (1975us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191775.996536:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3462
00000100:00100000:3.0:1776191775.996952:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008deca8e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630976512:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191776.762710:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1776191777.018403:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191777.018409:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191777.018412:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191777.018420:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4309
00000100:00080000:0.0:1776191777.018423:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191777.018428:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191777.018447:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000007f107848 x1862467630977088/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191777.018462:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191777.018464:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191777.018465:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191777.018468:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4309
00000100:00080000:0.0:1776191777.018469:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191777.018472:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191777.018537:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048073207 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630976768:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191777.018601:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191777.018629:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001e32cc58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630977024:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191777.018652:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191777.018672:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:2.0:1776191777.018676:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000446d5aa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630976576:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191777.018704:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191777.018710:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009f18df2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630976640:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191777.018739:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7743710 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630976832:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191777.018760:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191777.018775:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191777.018783:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000084541faf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630976896:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191777.018811:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191777.018820:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000085d4558 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630976704:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191777.018850:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191777.018853:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630976640
00000100:00100000:2.0:1776191777.018867:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048707662 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630976960:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191777.018901:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1896
00000100:00100000:2.0:1776191777.018905:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191777.018911:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ea296a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630976640:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191777.018967:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ea296a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630976640:12345-0@lo:400:kworker/u8:4.0 Request processed in 56us (207us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191777.018968:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630976768
00000100:00100000:3.0:1776191777.018975:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1896
00000100:00100000:2.0:1776191777.018993:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630976896
00000100:00100000:2.0:1776191777.019015:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3463
00000100:00100000:2.0:1776191777.019019:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000421d4a36 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630976768:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191777.019075:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000a5a67c63 x1862467630977216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191777.019079:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000421d4a36 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630976768:12345-0@lo:400:kworker/u8:4.0 Request processed in 57us (477us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191777.019142:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008deca8e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630977152:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191777.019173:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191777.019204:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f107848 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630977088:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191777.019226:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191777.019241:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5a67c63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630977216:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191777.019258:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191777.019281:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630976576
00000100:00100000:1.0:1776191777.019304:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630977152
00000100:00100000:1.0:1776191777.019329:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1745
00000100:00100000:1.0:1776191777.019333:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000067e0c0a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630976576:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191777.019359:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191777.019388:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000067e0c0a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630976576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (684us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191777.019394:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1745
00000100:00100000:1.0:1776191777.019407:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1746
00000100:00100000:1.0:1776191777.019411:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ebe193c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630977152:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191777.019421:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191777.019447:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ebe193c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630977152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (274us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191777.019452:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1746
00000100:00100000:1.0:1776191777.019469:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630977024
00000100:00100000:1.0:1776191777.019505:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630976960
00000100:00100000:1.0:1776191777.019520:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630977088
00000100:00100000:1.0:1776191777.019529:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630977216
00000100:00100000:1.0:1776191777.019538:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2179
00000100:00100000:1.0:1776191777.019542:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d3569406 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630977024:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191777.019569:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d3569406 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630977024:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (918us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191777.019575:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2179
00000100:00100000:1.0:1776191777.019589:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2180
00000100:00100000:1.0:1776191777.019592:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de02bb16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630976960:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191777.019621:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de02bb16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630976960:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (721us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191777.019625:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2180
00000100:00100000:1.0:1776191777.019634:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2530
00000100:00100000:1.0:1776191777.019637:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002599c576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630977088:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191777.019737:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191777.019768:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002599c576 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630977088:12345-0@lo:8:kworker/u8:4.0 Request processed in 129us (541us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191777.019774:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2530
00000100:00100000:1.0:1776191777.019785:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2531
00000100:00100000:1.0:1776191777.019787:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f2c8d2dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630977216:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191777.019865:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191777.019888:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f2c8d2dd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630977216:12345-0@lo:8:kworker/u8:4.0 Request processed in 99us (629us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191777.019893:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2531
00000100:00100000:1.0:1776191777.019936:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008deca8e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630977152:0@lo:13:osp-pre-0-0.0
00000100:00080000:1.0:1776191777.019965:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191777.019968:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191777.019972:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f107848 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630977088:0@lo:8:kworker/u8:4.0
00000100:00080000:1.0:1776191777.019980:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191777.019982:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191777.019985:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5a67c63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630977216:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191777.020058:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630976832
00000100:00100000:1.0:1776191777.020082:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630976704
00000100:00100000:1.0:1776191777.020100:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5094
00000100:00100000:1.0:1776191777.020103:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027bfcbd4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630976832:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191777.020136:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027bfcbd4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630976832:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (1362us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191777.020141:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5094
00000100:00100000:1.0:1776191777.020152:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5095
00000100:00100000:1.0:1776191777.020155:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2c7adec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630976704:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191777.020180:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2c7adec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630976704:12345-0@lo:400:kworker/u8:4.0 Request processed in 24us (1331us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191777.020188:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5095
00000100:00100000:0.0:1776191777.020388:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000446d5aa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630976576:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191777.020399:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7743710 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630976832:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191777.020408:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048073207 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630976768:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191777.020417:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001e32cc58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630977024:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191777.020468:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b2d11c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630977280:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191777.020849:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191777.020879:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009f18df2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630976640:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191777.020895:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776191777.020900:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c251e98f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630977344:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191777.020921:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191777.020946:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630977280
00000100:00100000:0.0:1776191777.020973:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630977344
00000100:00100000:0.0:1776191777.020990:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5096
00000100:00100000:0.0:1776191777.020993:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001e32cc58 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630977280:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191777.021028:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001e32cc58 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630977280:12345-0@lo:400:kworker/u8:4.0 Request processed in 33us (180us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191777.021059:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5096
00000100:00100000:0.0:1776191777.021071:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5097
00000100:00100000:0.0:1776191777.021074:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009f18df2b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630977344:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191777.021100:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009f18df2b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630977344:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (179us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191777.021117:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5097
00000100:00100000:0.0:1776191777.021150:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c251e98f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630977344:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191777.021158:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b2d11c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630977280:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191777.021194:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000085d4558 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630976704:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191777.021204:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048707662 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630976960:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191777.022341:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3464
00000100:00100000:3.0:1776191777.022508:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000500f9601 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630976896:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191777.022586:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3463
00000100:00100000:3.0:1776191777.022587:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000500f9601 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630976896:12345-0@lo:400:kworker/u8:4.0 Request processed in 79us (3773us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191777.022596:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3464
00000100:00100000:0.0:1776191777.022961:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000084541faf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630976896:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191777.793086:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191778.660195:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191778.660240:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191778.660332:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613821504
00000100:00100000:3.0:1776191778.660346:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191778.660388:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5098
00000100:00100000:3.0:1776191778.660392:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191778.660398:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e920d54 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613821504:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:3.0:1776191778.660440:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613821568
00000100:00100000:3.0:1776191778.660471:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5099
00000100:00100000:0.0:1776191778.660475:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e920d54 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613821504:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 77us (286us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191778.660480:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000231e853d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613821568:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:0.0:1776191778.660488:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5098
00000100:00100000:3.0:1776191778.660515:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000231e853d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613821568:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 38us (126us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191778.660524:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5099
00000100:00100000:3.0:1776191778.660730:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191778.661024:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613821440
00000100:00100000:2.0:1776191778.661092:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1897
00000100:00100000:2.0:1776191778.661097:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e58aa936 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613821440:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191778.661136:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e58aa936 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613821440:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 37us (791us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191778.661143:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1897
00000100:00100000:1.0:1776191778.668719:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613821696
00000100:00100000:1.0:1776191778.668905:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613821632
00000100:00100000:2.0:1776191778.668950:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2181
00000100:00100000:2.0:1776191778.668958:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006df8bd7e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613821632:12345-192.168.203.36@tcp:400:kworker/u8:3.0
00000100:00100000:2.0:1776191778.669357:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006df8bd7e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613821632:12345-192.168.203.36@tcp:400:kworker/u8:3.0 Request processed in 397us (8626us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191778.669366:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2181
00000100:00100000:2.0:1776191778.669390:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2532
00000100:00100000:2.0:1776191778.669394:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000033b3f754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613821696:12345-192.168.203.36@tcp:8:kworker/u8:3.0
00010000:02020000:2.0:1776191778.669489:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191778.669518:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000033b3f754 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613821696:12345-192.168.203.36@tcp:8:kworker/u8:3.0 Request processed in 123us (9278us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191778.669525:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2532
00010000:00010000:3.0:1776191778.810390:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191779.834346:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191780.090503:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630977408:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191780.090585:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191780.090895:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630977408
00000100:00100000:1.0:1776191780.090943:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3465
00000100:00100000:1.0:1776191780.090950:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000084541faf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630977408:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191780.090984:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191780.091051:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000084541faf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630977408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (448us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191780.091059:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3465
00000100:00100000:0.0:1776191780.091325:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630977408:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191780.858796:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191781.116289:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191781.116317:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000819bd127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630977472:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191781.116390:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191781.116470:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630977472
00000100:00100000:1.0:1776191781.116576:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3466
00000100:00100000:1.0:1776191781.116583:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048707662 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630977472:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191781.116620:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191781.116677:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048707662 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630977472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (288us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191781.116685:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3466
00000100:00100000:3.0:1776191781.118182:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000819bd127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630977472:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191781.882292:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191782.138438:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191782.138456:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd341e03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630977536:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191782.138536:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191782.138875:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191782.138880:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191782.138883:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191782.138888:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4315
00000100:00080000:1.0:1776191782.138890:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191782.138896:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191782.138916:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000d5419f64 x1862467630978048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191782.138931:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191782.138935:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191782.138936:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191782.138938:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4315
00000100:00080000:1.0:1776191782.138940:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191782.138943:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191782.138954:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000188ce8c6 x1862467630978112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191782.138991:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ade5f5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630977728:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191782.139025:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191782.139064:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000695c22eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630977984:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191782.139103:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191782.139120:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:1.0:1776191782.139126:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c02ea968 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630977664:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191782.139156:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191782.139173:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007a366bf6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630977920:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191782.139181:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630977536
00000100:00100000:1.0:1776191782.139197:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191782.139228:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1747
00000100:00100000:1.0:1776191782.139229:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d5419f64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630978048:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191782.139246:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d1858cc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630977536:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191782.139267:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191782.139283:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630978112:0@lo:8:kworker/u8:2.0
00002000:00000024:2.0:1776191782.139291:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191782.139309:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191782.139368:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630977728
00000100:00100000:3.0:1776191782.139396:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5100
00000100:00100000:3.0:1776191782.139401:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000118a85b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630977728:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191782.139820:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630977984
00000100:00100000:1.0:1776191782.139849:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630978048
00000100:00100000:1.0:1776191782.139865:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630978112
00000100:00100000:1.0:1776191782.139879:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2182
00000100:00100000:1.0:1776191782.139884:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000053bdf8f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630977984:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191782.139921:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000053bdf8f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630977984:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (819us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191782.139929:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2182
00000100:00100000:1.0:1776191782.139946:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2533
00000100:00100000:1.0:1776191782.139950:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bedc80a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630978048:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:1.0:1776191782.140074:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191782.140615:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000118a85b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630977728:12345-0@lo:400:kworker/u8:2.0 Request processed in 1201us (1578us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191782.140625:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5100
00000100:00100000:3.0:1776191782.140686:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2534
00000100:00100000:3.0:1776191782.140691:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000083657c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630978112:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191782.140781:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191782.140819:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000083657c43 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630978112:12345-0@lo:8:kworker/u8:2.0 Request processed in 127us (1511us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191782.140826:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2534
00000100:00100000:3.0:1776191782.140868:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630977920
00000100:00100000:3.0:1776191782.140895:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3467
00000100:00100000:3.0:1776191782.140900:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d7848e1b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630977920:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191782.140934:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d7848e1b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630977920:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (1737us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191782.140940:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3467
00000100:00100000:3.0:1776191782.140991:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007a366bf6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630977920:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191782.141003:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ade5f5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630977728:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191782.141012:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000695c22eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630977984:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191782.141149:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bedc80a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630978048:12345-0@lo:8:kworker/u8:2.0 Request processed in 1197us (1883us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191782.141156:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2533
00000100:00080000:1.0:1776191782.141184:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191782.141188:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191782.141191:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d5419f64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630978048:0@lo:8:kworker/u8:2.0
00000100:00080000:1.0:1776191782.141199:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191782.141201:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191782.141203:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630978112:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191782.141297:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0c75a22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630977792:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191782.141347:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191782.141364:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057916d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630978176:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191782.141386:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191782.141410:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [1->0]
00000100:00100000:0.0:1776191782.141416:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000061b94ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630977600:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191782.141437:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191782.141451:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008611bf7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630977856:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191782.141471:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191782.141500:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000059e49ec2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630978240:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191782.141520:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191782.141551:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630977664
00000100:00100000:0.0:1776191782.141578:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1898
00000100:00100000:0.0:1776191782.141582:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae4705ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630977664:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191782.141628:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae4705ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630977664:12345-0@lo:400:kworker/u8:2.0 Request processed in 45us (2473us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191782.141634:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1898
00000100:00100000:0.0:1776191782.141662:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630977600
00000100:00100000:0.0:1776191782.141683:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1748
00000100:00100000:0.0:1776191782.141686:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c251e98f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630977600:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191782.141700:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191782.141731:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c251e98f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630977600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (293us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191782.141737:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1748
00000100:00100000:0.0:1776191782.141755:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630978176
00000100:00100000:0.0:1776191782.141775:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630977856
00000100:00100000:0.0:1776191782.141789:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630978240
00000100:00100000:0.0:1776191782.141811:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5101
00000100:00100000:0.0:1776191782.141815:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b2d11c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630978176:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191782.141843:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b2d11c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630978176:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (457us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191782.141849:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5101
00000100:00100000:0.0:1776191782.141860:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5102
00000100:00100000:0.0:1776191782.141863:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048073207 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630977856:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191782.141886:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048073207 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630977856:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (415us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191782.141893:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5102
00000100:00100000:0.0:1776191782.141903:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5103
00000100:00100000:0.0:1776191782.141905:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f7743710 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630978240:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191782.141930:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f7743710 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630978240:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (409us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191782.141934:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5103
00000100:00100000:0.0:1776191782.141997:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000061b94ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630977600:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191782.142008:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008611bf7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630977856:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191782.142015:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000059e49ec2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630978240:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191782.142023:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057916d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630978176:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191782.142086:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c02ea968 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630977664:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191782.142105:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630977792
00000100:00100000:0.0:1776191782.142128:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3468
00000100:00100000:0.0:1776191782.142131:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000085d4558 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630977792:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191782.142163:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000085d4558 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630977792:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (816us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191782.142168:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3468
00000100:00100000:0.0:1776191782.142191:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0c75a22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630977792:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191782.143732:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d1858cc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630977536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4480us (5190us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191782.143746:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1747
00000100:00100000:0.0:1776191782.144199:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd341e03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630977536:0@lo:13:osp-pre-0-0.0
00010000:00010000:3.0:1776191782.906354:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191783.771244:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191783.771363:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191783.771399:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191783.771401:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613821760
00000100:00100000:2.0:1776191783.771430:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191783.771452:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1899
00000100:00100000:0.0:1776191783.771460:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000deab4b38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613821760:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191783.771468:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191783.771472:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613822016
00000100:00100000:3.0:1776191783.771505:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613821952
00000100:00100000:2.0:1776191783.771524:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2535
00000100:00100000:2.0:1776191783.771530:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ec7cac8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613822016:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00000100:00100000:0.0:1776191783.771534:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000deab4b38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613821760:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 75us (298us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191783.771541:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1899
00000100:00100000:3.0:1776191783.771545:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2183
00000100:00100000:3.0:1776191783.771551:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004faaa807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613821952:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191783.771597:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004faaa807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613821952:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 46us (130us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191783.771608:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2183
00010000:02020000:2.0:1776191783.771794:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191783.772027:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ec7cac8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613822016:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 406us (536us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191783.772059:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2535
00000100:00100000:0.0:1776191783.776556:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613821888
00000100:00100000:0.0:1776191783.776691:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613821824
00000100:00100000:0.0:1776191783.776727:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5104
00000100:00100000:0.0:1776191783.776735:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ff6c3c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613821888:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191783.776825:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ff6c3c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613821888:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 90us (5462us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191783.776833:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5104
00000100:00100000:0.0:1776191783.776855:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5105
00000100:00100000:0.0:1776191783.776860:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000138721a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613821824:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191783.776886:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000138721a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613821824:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 26us (5456us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191783.776892:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5105
00010000:00010000:3.0:1776191783.930812:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191784.954253:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191785.210288:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191785.210309:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005cfbecd5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630978304:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191785.210373:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191785.210684:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630978304
00000100:00100000:1.0:1776191785.210739:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3469
00000100:00100000:1.0:1776191785.210743:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f9388e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630978304:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191785.210774:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191785.211302:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f9388e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630978304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 556us (929us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191785.211309:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3469
00000100:00100000:0.0:1776191785.213438:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005cfbecd5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630978304:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191785.979845:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191786.237022:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005f9ce4ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630978368:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191786.237121:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191786.237248:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630978368
00000100:00100000:1.0:1776191786.237299:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3470
00000100:00100000:1.0:1776191786.237305:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a5a67c63 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630978368:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191786.237337:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191786.237393:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a5a67c63 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630978368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (273us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191786.237400:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3470
00000100:00100000:3.0:1776191786.237489:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005f9ce4ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630978368:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191787.002305:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191787.258410:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfc0fcff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630978432:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191787.258488:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191787.258532:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1b66093 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630978496:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191787.258558:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191787.258606:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630978432
00000100:00100000:0.0:1776191787.258654:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630978496
00000100:00100000:0.0:1776191787.258675:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1749
00000100:00100000:0.0:1776191787.258681:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f107848 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630978432:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191787.258711:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191787.258747:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f107848 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630978432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (260us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191787.258754:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1749
00000100:00100000:0.0:1776191787.258781:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1750
00000100:00100000:0.0:1776191787.258786:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000057916d34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630978496:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191787.258794:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191787.258814:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000057916d34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630978496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 28us (256us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191787.258819:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1750
00000100:00100000:0.0:1776191787.258874:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfc0fcff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630978432:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191787.258890:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1b66093 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630978496:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191787.261438:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000278fd18d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630978560:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191787.261518:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191787.261657:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000354fd625 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630978752:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191787.261690:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191787.261734:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630978752
00000100:00100000:2.0:1776191787.261772:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5106
00000100:00100000:2.0:1776191787.261777:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ff9f217e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630978752:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191787.261822:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ff9f217e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630978752:12345-0@lo:400:kworker/u8:4.0 Request processed in 44us (131us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191787.261828:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5106
00000100:00100000:2.0:1776191787.261874:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000354fd625 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630978752:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191787.261916:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a7e1534c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630978624:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191787.261938:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191787.261956:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1776191787.261961:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ebbe68e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630978688:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191787.261983:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191787.262006:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630978624
00000100:00100000:2.0:1776191787.262027:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5107
00000100:00100000:2.0:1776191787.262031:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bfc0fcff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630978624:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191787.262094:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bfc0fcff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630978624:12345-0@lo:400:kworker/u8:4.0 Request processed in 62us (155us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191787.262099:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5107
00000100:00100000:2.0:1776191787.262123:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a7e1534c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630978624:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191787.263197:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630978560
00000100:00100000:0.0:1776191787.263255:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1900
00000100:00100000:0.0:1776191787.263260:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a4afbcc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630978560:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191787.263375:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630978688
00000100:00100000:2.0:1776191787.263401:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3471
00000100:00100000:2.0:1776191787.263413:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005f9ce4ac pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630978688:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191787.263451:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005f9ce4ac pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630978688:12345-0@lo:400:kworker/u8:4.0 Request processed in 38us (1469us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191787.263457:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3471
00000100:00100000:2.0:1776191787.263488:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ebbe68e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630978688:0@lo:400:kworker/u8:4.0
00000100:00080000:3.0:1776191787.269063:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191787.269070:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191787.269073:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191787.269081:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4320
00000100:00080000:3.0:1776191787.269084:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191787.269090:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191787.269110:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000f697c3d5 x1862467630978880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191787.269132:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191787.269135:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191787.269136:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191787.269139:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4320
00000100:00080000:3.0:1776191787.269140:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191787.269143:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191787.269167:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000b3d84175 x1862467630978944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191787.269233:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f697c3d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630978880:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191787.269294:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191787.269319:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b3d84175 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630978944:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191787.269337:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191787.269371:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630978880
00000100:00100000:3.0:1776191787.269400:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630978944
00000100:00100000:3.0:1776191787.269416:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2536
00000100:00100000:3.0:1776191787.269421:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000038b90f22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630978880:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191787.269529:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191787.269569:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000038b90f22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630978880:12345-0@lo:8:kworker/u8:4.0 Request processed in 147us (275us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191787.269579:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2536
00000100:00100000:3.0:1776191787.269593:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2537
00000100:00100000:3.0:1776191787.269596:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ebbe68e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630978944:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191787.269675:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191787.269694:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ebbe68e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630978944:12345-0@lo:8:kworker/u8:4.0 Request processed in 97us (358us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191787.269700:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2537
00000100:00080000:3.0:1776191787.269735:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191787.269738:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191787.269741:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f697c3d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630978880:0@lo:8:kworker/u8:4.0
00000100:00080000:3.0:1776191787.269747:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191787.269748:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191787.269750:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b3d84175 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630978944:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191787.269771:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037535091 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630979072:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191787.269795:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191787.269810:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1776191787.269815:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ddf82b42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630979008:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191787.269837:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191787.270563:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776191787.270576:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000871997a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630978816:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191787.270624:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191787.270654:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630978816
00000100:00100000:2.0:1776191787.270690:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3472
00000100:00100000:2.0:1776191787.270694:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd341e03 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630978816:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191787.270733:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd341e03 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630978816:12345-0@lo:400:kworker/u8:4.0 Request processed in 37us (110us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191787.270738:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3472
00000100:00100000:2.0:1776191787.270771:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000871997a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630978816:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191787.271069:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630979072
00000100:00100000:2.0:1776191787.271160:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630979008
00000100:00100000:2.0:1776191787.271192:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5108
00000100:00100000:2.0:1776191787.271196:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f697c3d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630979008:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191787.271243:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f697c3d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630979008:12345-0@lo:400:kworker/u8:4.0 Request processed in 46us (1408us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191787.271249:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5108
00000100:00100000:2.0:1776191787.271285:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ddf82b42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630979008:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191787.271626:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5109
00000100:00100000:3.0:1776191787.271630:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d84175 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630979072:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191787.271673:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d84175 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630979072:12345-0@lo:400:kworker/u8:4.0 Request processed in 42us (1878us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191787.271682:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5109
00000100:00100000:3.0:1776191787.271708:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037535091 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630979072:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191787.278819:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a4afbcc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630978560:12345-0@lo:400:kworker/u8:4.0 Request processed in 15549us (17293us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191787.281553:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1900
00000100:00100000:1.0:1776191787.283749:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000278fd18d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630978560:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191788.027388:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191788.893718:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191788.893834:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191788.895500:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191788.895926:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613822080
00000100:00100000:0.0:1776191788.895992:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1901
00000100:00100000:0.0:1776191788.895999:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dbba1dca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613822080:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191788.896091:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dbba1dca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613822080:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 91us (2382us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191788.896100:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1901
00000100:00100000:3.0:1776191788.897790:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191788.898550:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613822336
00000100:00100000:1.0:1776191788.898592:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2538
00000100:00100000:1.0:1776191788.898599:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000354fd625 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613822336:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:1.0:1776191788.898693:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191788.898747:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000354fd625 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613822336:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 147us (964us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191788.898754:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2538
00000100:00100000:3.0:1776191788.899181:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191788.902368:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613822144
00000100:00100000:2.0:1776191788.902436:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613822208
00000100:00100000:2.0:1776191788.902480:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5110
00000100:00100000:2.0:1776191788.902486:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000037535091 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613822144:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191788.902563:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000037535091 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613822144:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 76us (8730us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191788.902572:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5110
00000100:00100000:2.0:1776191788.902595:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5111
00000100:00100000:2.0:1776191788.902599:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7e1534c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613822208:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191788.902624:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7e1534c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613822208:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 24us (7226us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191788.902630:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5111
00000100:00100000:2.0:1776191788.902688:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613822272
00000100:00100000:2.0:1776191788.902720:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2184
00000100:00100000:2.0:1776191788.902724:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1b66093 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613822272:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191788.902751:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1b66093 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613822272:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 25us (3572us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191788.902757:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2184
00010000:00010000:3.0:1776191789.050220:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191790.074807:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191790.330906:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005cfbecd5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630979136:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191790.330975:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191790.331092:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630979136
00000100:00100000:1.0:1776191790.331135:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3473
00000100:00100000:1.0:1776191790.331141:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000819bd127 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630979136:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191790.331170:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191790.331215:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000819bd127 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630979136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (241us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191790.331221:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3473
00000100:00100000:3.0:1776191790.331302:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005cfbecd5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630979136:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191791.098348:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191791.355497:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191791.355517:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008deca8e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630979200:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191791.355580:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191791.355663:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630979200
00000100:00100000:2.0:1776191791.355707:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3474
00000100:00100000:2.0:1776191791.355713:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000061b94ee pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630979200:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191791.355753:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191791.355919:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000061b94ee pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630979200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 205us (339us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191791.355927:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3474
00000100:00100000:3.0:1776191791.356420:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008deca8e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630979200:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191792.122458:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1776191792.378532:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191792.378538:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191792.378542:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191792.378549:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4325
00000100:00080000:3.0:1776191792.378552:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00100000:0.0:1776191792.378557:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000446d5aa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630979264:0@lo:400:kworker/u8:4.0
00000100:00080000:3.0:1776191792.378558:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191792.378577:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000008611bf7d x1862467630979712/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191792.378593:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191792.378598:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1776191792.378599:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000278fd18d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630979392:0@lo:400:kworker/u8:4.0
00000100:00080000:3.0:1776191792.378600:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191792.378605:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4325
00000100:00080000:3.0:1776191792.378609:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191792.378611:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191792.378622:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000188ce8c6 x1862467630979776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191792.378633:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191792.378645:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191792.378663:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008611bf7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630979712:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191792.378670:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000871997a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630979520:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191792.378670:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c02ea968 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630979648:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191792.378728:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040035503 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630979328:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191792.378895:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191792.378921:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630979776:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191792.378940:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191792.378968:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630979712
00000100:00100000:3.0:1776191792.378989:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630979776
00000100:00100000:3.0:1776191792.379001:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2539
00000100:00100000:3.0:1776191792.379005:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ade5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630979712:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191792.379111:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:02020000:3.0:1776191792.379115:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191792.379139:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000695c22eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630979904:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191792.379155:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ade5f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630979712:12345-0@lo:8:kworker/u8:4.0 Request processed in 148us (260us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191792.379163:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2539
00000100:00100000:0.0:1776191792.379174:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191792.379179:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2540
00000100:00100000:3.0:1776191792.379183:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a366bf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630979776:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191792.379309:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191792.379329:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a366bf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630979776:12345-0@lo:8:kworker/u8:4.0 Request processed in 145us (389us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191792.379334:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2540
00000100:00080000:3.0:1776191792.379365:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191792.379368:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191792.379371:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008611bf7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630979712:0@lo:8:kworker/u8:4.0
00000100:00080000:3.0:1776191792.379377:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191792.379379:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191792.379381:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630979776:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191792.379695:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ddf82b42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630979456:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191792.379791:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630979392
00000100:00100000:3.0:1776191792.379827:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630979520
00000100:00100000:3.0:1776191792.379840:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3475
00000100:00100000:3.0:1776191792.379844:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005cfbecd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630979392:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191792.379891:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005cfbecd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630979392:12345-0@lo:400:kworker/u8:4.0 Request processed in 46us (1248us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191792.379897:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3475
00000100:00100000:3.0:1776191792.379907:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3476
00000100:00100000:3.0:1776191792.379910:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000059e49ec2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630979520:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191792.379941:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000059e49ec2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630979520:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (831us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191792.379946:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3476
00000100:00100000:3.0:1776191792.379962:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630979264
00000100:00100000:3.0:1776191792.379981:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1902
00000100:00100000:3.0:1776191792.379984:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b9375c8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630979264:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191792.380008:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b9375c8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630979264:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (1379us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191792.380017:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1902
00000100:00100000:1.0:1776191792.380731:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191792.380764:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008611bf7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630980032:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191792.380791:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191792.380891:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000446d5aa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630979264:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191792.380903:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000871997a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630979520:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191792.380924:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191792.380929:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630979968:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191792.380988:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630979904
00000100:00100000:1.0:1776191792.381007:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000278fd18d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630979392:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191792.381054:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5112
00000100:00100000:0.0:1776191792.381059:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005783e1b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630979904:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191792.381069:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630980032
00000100:00100000:1.0:1776191792.381102:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1751
00000100:00100000:0.0:1776191792.381106:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005783e1b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630979904:12345-0@lo:400:kworker/u8:4.0 Request processed in 44us (1932us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191792.381110:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049908ee0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630980032:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191792.381124:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5112
00002000:00000024:1.0:1776191792.381135:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191792.381150:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191792.381171:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d5419f64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630979840:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191792.381178:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049908ee0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630980032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (385us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191792.381184:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1751
00000100:00100000:0.0:1776191792.381216:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191792.381219:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008611bf7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630980032:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191792.381251:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630979456
00000100:00100000:0.0:1776191792.381259:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630979840
00000100:00100000:1.0:1776191792.381276:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5113
00000100:00100000:1.0:1776191792.381280:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd188b2d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630979456:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191792.381311:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd188b2d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630979456:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (162us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191792.381946:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5114
00000100:00100000:0.0:1776191792.381951:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000278fd18d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630979840:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191792.381990:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000278fd18d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630979840:12345-0@lo:400:kworker/u8:4.0 Request processed in 39us (776us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191792.381997:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5114
00000100:00100000:1.0:1776191792.382460:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5113
00000100:00100000:3.0:1776191792.382488:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630979648
00000100:00100000:1.0:1776191792.382494:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191792.382527:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000695c22eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630979904:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191792.382631:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2185
00000100:00100000:1.0:1776191792.382635:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630979968
00000100:00100000:3.0:1776191792.382638:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e56aacf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630979648:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191792.382663:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1752
00000100:00100000:1.0:1776191792.382669:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af393e55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3365:x1862467630979968:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191792.382683:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191792.382688:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e56aacf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3363:x1862467630979648:12345-0@lo:400:kworker/u8:4.0 Request processed in 49us (1957us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191792.382695:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2185
00000100:00100000:1.0:1776191792.383192:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af393e55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630979968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 522us (698us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191792.383199:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1752
00000100:00100000:1.0:1776191792.383230:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c02ea968 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630979648:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191792.383244:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ddf82b42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630979456:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191792.383269:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d5419f64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630979840:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191792.383666:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630979968:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191792.384894:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191792.385141:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0c75a22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630979584:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191792.385184:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191792.385340:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630979328
00000100:00100000:3.0:1776191792.385393:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5115
00000100:00100000:3.0:1776191792.385398:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008deca8e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630979328:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191792.385609:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630979584
00000100:00100000:0.0:1776191792.385639:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2186
00000100:00100000:0.0:1776191792.385643:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d0c84519 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630979584:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191792.385691:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008deca8e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630979328:12345-0@lo:400:kworker/u8:4.0 Request processed in 292us (800us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191792.385699:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5115
00000100:00100000:0.0:1776191792.385807:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d0c84519 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630979584:12345-0@lo:400:kworker/u8:4.0 Request processed in 162us (622us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191792.385814:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2186
00000100:00100000:1.0:1776191792.388942:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040035503 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630979328:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191792.388963:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0c75a22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630979584:0@lo:400:kworker/u8:4.0
00010000:00010000:0.0:1776191793.146444:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191794.013314:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191794.013375:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191794.013412:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191794.013444:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191794.013447:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613822592
00000100:00100000:0.0:1776191794.013480:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191794.013482:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613822400
00000100:00100000:3.0:1776191794.013507:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613822656
00000100:00100000:0.0:1776191794.013528:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613822464
00000100:00100000:1.0:1776191794.013529:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1903
00000100:00100000:1.0:1776191794.013539:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fec76140 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613822400:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191794.013548:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2187
00000100:00100000:3.0:1776191794.013554:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000871997a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613822592:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191794.013575:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613822528
00000100:00100000:1.0:1776191794.013611:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fec76140 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613822400:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 72us (198us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191794.013619:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1903
00000100:00100000:0.0:1776191794.013655:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5116
00000100:00100000:0.0:1776191794.013662:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ddf82b42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613822464:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191794.013689:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000871997a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613822592:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 132us (312us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191794.013702:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ddf82b42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613822464:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 35us (390us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191794.013702:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2187
00000100:00100000:0.0:1776191794.013712:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5116
00000100:00100000:0.0:1776191794.013736:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5117
00000100:00100000:3.0:1776191794.013742:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2541
00000100:00100000:0.0:1776191794.013743:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000446d5aa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613822528:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191794.013750:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000040035503 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613822656:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00000100:00100000:0.0:1776191794.013774:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000446d5aa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613822528:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 32us (330us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191794.013782:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5117
00010000:02020000:3.0:1776191794.013842:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191794.013870:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000040035503 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613822656:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 121us (392us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191794.013876:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2541
00010000:00010000:3.0:1776191794.170490:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191795.195334:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191795.450441:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000640b7818 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630980096:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191795.450510:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191795.450581:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630980096
00000100:00100000:3.0:1776191795.450636:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3477
00000100:00100000:3.0:1776191795.450642:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c02746a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630980096:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191795.450672:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191795.452875:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c02746a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630980096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2226us (2358us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191795.452889:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3477
00000100:00100000:0.0:1776191795.456990:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000640b7818 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630980096:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191796.218273:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191796.479185:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030c9704c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630980160:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191796.479259:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191796.479367:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630980160
00000100:00100000:0.0:1776191796.479424:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3478
00000100:00100000:0.0:1776191796.479429:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016dc0009 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630980160:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191796.479474:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191796.479876:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016dc0009 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630980160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 445us (617us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191796.479885:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3478
00000100:00100000:1.0:1776191796.479947:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030c9704c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630980160:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191797.244167:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191797.498197:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1776191797.498212:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630980224:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191797.498230:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0c75a22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630980288:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1776191797.498345:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191797.498350:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191797.498353:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191797.498358:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4330
00000100:00080000:2.0:1776191797.498361:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191797.498367:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191797.498387:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000086a13048 x1862467630980800/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191797.498396:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009916a1d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630980480:0@lo:400:kworker/u8:2.0
00000100:00080000:2.0:1776191797.498401:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191797.498404:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191797.498405:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191797.498408:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4330
00000100:00080000:2.0:1776191797.498409:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191797.498412:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191797.498448:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000003f4bfd6c x1862467630980864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191797.498489:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085501c10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630980352:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191797.504344:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191797.504398:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea373370 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630980416:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191797.504430:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191797.504446:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a426c55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630980672:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191797.504469:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191797.504517:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630980672
00000100:00100000:1.0:1776191797.504560:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2188
00000100:00100000:1.0:1776191797.504566:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005fd6c919 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630980672:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191797.504619:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005fd6c919 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630980672:12345-0@lo:400:kworker/u8:2.0 Request processed in 52us (149us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191797.504626:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2188
00000100:00100000:1.0:1776191797.504665:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a426c55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630980672:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191797.504691:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630980416
00000100:00100000:1.0:1776191797.504724:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5118
00000100:00100000:1.0:1776191797.504727:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000640b7818 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630980416:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191797.504760:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000640b7818 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630980416:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (330us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191797.504766:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5118
00000100:00100000:1.0:1776191797.504789:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea373370 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630980416:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191797.504838:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630980224
00000100:00100000:1.0:1776191797.504859:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1753
00000100:00100000:1.0:1776191797.504863:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007756d7ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630980224:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191797.504883:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191797.504917:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007756d7ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630980224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (579us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191797.504922:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1753
00000100:00100000:1.0:1776191797.504993:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630980224:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191797.505022:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086a13048 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630980800:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191797.505067:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191797.505082:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003f4bfd6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630980864:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191797.505101:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191797.505126:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630980800
00000100:00100000:1.0:1776191797.505141:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630980864
00000100:00100000:1.0:1776191797.505153:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2542
00000100:00100000:1.0:1776191797.505156:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ea373370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630980800:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:1.0:1776191797.505251:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191797.505292:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ea373370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630980800:12345-0@lo:8:kworker/u8:2.0 Request processed in 134us (225us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191797.505297:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2542
00000100:00100000:1.0:1776191797.505309:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2543
00000100:00100000:1.0:1776191797.505312:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a426c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630980864:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:1.0:1776191797.505394:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191797.505417:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a426c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630980864:12345-0@lo:8:kworker/u8:2.0 Request processed in 103us (315us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191797.505422:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2543
00000100:00080000:1.0:1776191797.505445:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191797.505449:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191797.505452:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086a13048 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630980800:0@lo:8:kworker/u8:2.0
00000100:00080000:1.0:1776191797.505460:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191797.505463:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191797.505464:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003f4bfd6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630980864:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191797.506048:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191797.506070:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a0c5ca5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630980736:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191797.506097:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191797.509802:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630980480
00000100:00100000:1.0:1776191797.509876:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3479
00000100:00100000:1.0:1776191797.509883:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ec42a12f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630980480:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191797.509975:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ec42a12f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630980480:12345-0@lo:400:kworker/u8:2.0 Request processed in 91us (3929us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191797.509982:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3479
00000100:00100000:1.0:1776191797.510009:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630980736
00000100:00100000:1.0:1776191797.510056:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2189
00000100:00100000:1.0:1776191797.510061:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009df06d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630980736:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191797.510094:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009df06d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630980736:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (3997us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191797.510100:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2189
00000100:00100000:0.0:1776191797.510965:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009916a1d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630980480:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191797.510980:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a0c5ca5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630980736:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191797.514291:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191797.514359:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030c9704c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630980544:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191797.514404:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191797.514421:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ee7172c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630980928:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191797.514442:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191797.514581:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630980544
00000100:00100000:3.0:1776191797.514892:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630980928
00000100:00100000:3.0:1776191797.514921:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5119
00000100:00100000:3.0:1776191797.514926:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c02ea968 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630980544:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191797.514976:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c02ea968 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630980544:12345-0@lo:400:kworker/u8:2.0 Request processed in 49us (572us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191797.514986:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5119
00000100:00100000:3.0:1776191797.515001:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5120
00000100:00100000:3.0:1776191797.515005:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000695c22eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630980928:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191797.515027:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000695c22eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630980928:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (585us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191797.515052:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5120
00000100:00100000:3.0:1776191797.515085:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030c9704c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630980544:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191797.515776:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ee7172c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630980928:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191797.516075:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630980288
00000100:00100000:1.0:1776191797.516126:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1754
00000100:00100000:1.0:1776191797.516130:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d5419f64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630980288:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191797.516150:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191797.516207:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d5419f64 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630980288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (1924us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191797.516213:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1754
00000100:00100000:0.0:1776191797.516242:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0c75a22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630980288:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191797.516451:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191797.516489:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630980608:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191797.516516:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191797.516539:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630980992:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191797.516564:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191797.516570:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630980352
00000100:00100000:2.0:1776191797.516588:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630980992
00000100:00100000:0.0:1776191797.516594:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1904
00000100:00100000:0.0:1776191797.516598:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cdaa8581 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630980352:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191797.516607:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5121
00000100:00100000:2.0:1776191797.516610:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000282b2f02 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630980992:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191797.516630:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cdaa8581 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630980352:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (180us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191797.516644:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1904
00000100:00100000:2.0:1776191797.516649:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000282b2f02 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630980992:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (85us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191797.516654:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5121
00000100:00100000:2.0:1776191797.516673:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085501c10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630980352:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191797.516683:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630980992:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191797.517228:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630980608
00000100:00100000:1.0:1776191797.517266:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3480
00000100:00100000:1.0:1776191797.517271:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030eda894 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630980608:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191797.517331:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030eda894 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630980608:12345-0@lo:400:kworker/u8:2.0 Request processed in 59us (814us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191797.517337:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3480
00000100:00100000:2.0:1776191797.517407:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630980608:0@lo:400:kworker/u8:2.0
00010000:00010000:3.0:1776191798.269137:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191799.136683:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191799.136939:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613822976
00000100:00100000:1.0:1776191799.136989:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2544
00000100:00100000:1.0:1776191799.136997:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000418a6d34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613822976:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:1.0:1776191799.137144:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191799.142146:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000418a6d34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613822976:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 5140us (5462us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191799.142164:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2544
00000100:00100000:0.0:1776191799.142652:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191799.142812:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191799.142842:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191799.142869:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191799.142908:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613822848
00000100:00100000:3.0:1776191799.142934:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613822784
00000100:00100000:2.0:1776191799.142957:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5122
00000100:00100000:2.0:1776191799.142964:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085501c10 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613822848:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191799.142971:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5123
00000100:00100000:3.0:1776191799.142978:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030c9704c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613822784:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191799.143073:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030c9704c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613822784:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 92us (228us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191799.143074:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085501c10 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613822848:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 106us (259us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191799.143088:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5122
00000100:00100000:1.0:1776191799.143373:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613822720
00000100:00100000:1.0:1776191799.143410:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1905
00000100:00100000:1.0:1776191799.143414:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009803db2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613822720:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191799.143456:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009803db2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613822720:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 41us (807us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191799.143462:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1905
00000100:00100000:1.0:1776191799.143494:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613822912
00000100:00100000:1.0:1776191799.143518:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2190
00000100:00100000:1.0:1776191799.143522:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009916a1d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613822912:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191799.143545:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009916a1d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613822912:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 22us (676us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191799.143551:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2190
00000100:00100000:3.0:1776191799.147299:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5123
00010000:00010000:0.0:1776191799.290278:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191800.314544:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191800.570456:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086a13048 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630981056:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191800.570588:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191800.570682:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630981056
00000100:00100000:1.0:1776191800.570733:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3481
00000100:00100000:1.0:1776191800.570739:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000128cb0b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630981056:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191800.570789:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191800.570837:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000128cb0b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630981056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (251us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191800.570844:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3481
00000100:00100000:2.0:1776191800.571067:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086a13048 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630981056:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191801.338801:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191801.594341:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1776191801.596708:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086a13048 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630981120:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191801.596783:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191801.597615:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630981120
00000100:00100000:3.0:1776191801.598074:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3482
00000100:00100000:3.0:1776191801.598083:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f210a7b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630981120:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191801.598161:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191801.598254:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f210a7b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630981120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 172us (1471us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191801.598262:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3482
00000100:00100000:2.0:1776191801.598510:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086a13048 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630981120:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191802.363346:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191802.618371:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000603b89b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630981312:0@lo:400:kworker/u8:2.0
00000100:00080000:2.0:1776191802.618373:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191802.618379:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191802.618382:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191802.618387:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4335
00000100:00080000:2.0:1776191802.618389:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191802.618394:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191802.618410:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000004c049762 x1862467630981696/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191802.618435:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191802.618438:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191802.618439:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191802.618442:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4335
00000100:00080000:2.0:1776191802.618444:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00100000:3.0:1776191802.618445:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1776191802.618447:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191802.618456:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000be243e0e x1862467630981760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191802.618485:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000068cadb2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630981248:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191802.618485:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630981312
00000100:00100000:2.0:1776191802.618518:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191802.618541:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5124
00000100:00100000:3.0:1776191802.618547:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0c75a22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630981312:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191802.618551:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009eabfd74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630981504:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191802.618574:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191802.618585:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b69f705b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630981888:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191802.618585:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0c75a22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630981312:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (140us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191802.618591:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5124
00000100:00100000:2.0:1776191802.618604:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191802.618617:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002d7eb8c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630981568:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191802.618655:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191802.618694:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008611bf7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630981184:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191802.618710:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000603b89b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630981312:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191802.618730:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ee7172c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630981952:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191802.618763:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191802.618771:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da0b0e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630981376:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191802.618794:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d72c3363 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630981440:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191802.618816:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191802.618834:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630981248
00000100:00100000:3.0:1776191802.618838:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002986576f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630981632:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191802.618863:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1906
00000100:00100000:0.0:1776191802.618868:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000364ff3a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630981248:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191802.618876:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191802.618909:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000364ff3a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630981248:12345-0@lo:400:kworker/u8:2.0 Request processed in 41us (391us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191802.618915:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1906
00000100:00100000:3.0:1776191802.618943:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630981504
00000100:00100000:3.0:1776191802.618963:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630981376
00000100:00100000:3.0:1776191802.618974:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3483
00000100:00100000:3.0:1776191802.618977:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cdf4b577 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630981504:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191802.619006:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cdf4b577 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630981504:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (431us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191802.619012:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3483
00000100:00100000:1.0:1776191802.619135:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3484
00000100:00100000:1.0:1776191802.619140:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000603b89b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630981376:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191802.619185:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000603b89b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630981376:12345-0@lo:400:kworker/u8:2.0 Request processed in 44us (370us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191802.619191:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3484
00000100:00100000:0.0:1776191802.619209:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630981184
00000100:00100000:0.0:1776191802.619237:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1755
00000100:00100000:0.0:1776191802.619241:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e964c59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630981184:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191802.619262:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191802.619298:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e964c59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630981184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (537us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191802.619304:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1755
00000100:00100000:0.0:1776191802.619326:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191802.619408:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630981952
00000100:00100000:0.0:1776191802.619431:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1756
00000100:00100000:0.0:1776191802.619436:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000780602c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630981952:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191802.619447:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191802.619479:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630981888
00000100:00100000:0.0:1776191802.619483:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000780602c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630981952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (154us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191802.619489:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1756
00000100:00100000:2.0:1776191802.619510:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5125
00000100:00100000:0.0:1776191802.619529:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191802.619529:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eea60842 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630981888:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191802.619552:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005c5a025e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630981824:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191802.619570:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eea60842 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630981888:12345-0@lo:400:kworker/u8:2.0 Request processed in 52us (963us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191802.619578:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5125
00000100:00100000:0.0:1776191802.619584:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191802.619595:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630981440
00000100:00100000:2.0:1776191802.619618:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630981824
00000100:00100000:0.0:1776191802.619631:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008611bf7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630981184:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191802.619637:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5126
00000100:00100000:2.0:1776191802.619642:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007c5815f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630981440:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191802.619669:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5127
00000100:00100000:0.0:1776191802.619674:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009aecc0b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630981824:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191802.619677:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007c5815f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630981440:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (160us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191802.619685:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5126
00000100:00100000:0.0:1776191802.619720:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009aecc0b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630981824:12345-0@lo:400:kworker/u8:2.0 Request processed in 44us (136us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191802.619728:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5127
00000100:00100000:2.0:1776191802.619734:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d72c3363 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630981440:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191802.619747:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005c5a025e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630981824:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191802.619776:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000068cadb2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630981248:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191802.619790:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009eabfd74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630981504:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191802.619794:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ee7172c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630981952:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191802.619801:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b69f705b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630981888:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191802.619843:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630981568
00000100:00100000:0.0:1776191802.619867:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630981632
00000100:00100000:0.0:1776191802.619883:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2191
00000100:00100000:0.0:1776191802.619887:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000188ce8c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630981568:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191802.619920:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000188ce8c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630981568:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (1266us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191802.619926:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2191
00000100:00100000:2.0:1776191802.619943:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2192
00000100:00100000:2.0:1776191802.619948:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e3e1154 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630981632:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191802.619982:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e3e1154 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630981632:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (1108us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191802.620318:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004c049762 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630981696:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191802.620436:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191802.620455:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be243e0e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630981760:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191802.620476:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191802.620514:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630981696
00000100:00100000:0.0:1776191802.620534:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630981760
00000100:00100000:0.0:1776191802.620546:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2545
00000100:00100000:0.0:1776191802.620549:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001129c7cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630981696:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191802.620670:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191802.620703:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001129c7cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630981696:12345-0@lo:8:kworker/u8:2.0 Request processed in 153us (268us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191802.620710:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2545
00000100:00100000:0.0:1776191802.620723:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2546
00000100:00100000:0.0:1776191802.620726:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b37332da pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630981760:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191802.620812:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191802.620835:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b37332da pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630981760:12345-0@lo:8:kworker/u8:2.0 Request processed in 107us (358us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191802.620841:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2546
00000100:00080000:0.0:1776191802.620868:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191802.620872:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191802.620876:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004c049762 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630981696:0@lo:8:kworker/u8:2.0
00000100:00080000:0.0:1776191802.620883:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191802.620886:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191802.620888:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be243e0e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630981760:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191802.620917:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002d7eb8c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630981568:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191802.621342:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da0b0e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630981376:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191802.621367:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002986576f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630981632:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191802.622664:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2192
00010000:00010000:3.0:1776191803.388222:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191804.251462:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191804.251518:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191804.252103:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613823040
00000100:00100000:3.0:1776191804.252172:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1907
00000100:00100000:3.0:1776191804.252190:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ea43294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613823040:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191804.252259:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ea43294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613823040:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 80us (804us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191804.252266:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1907
00000100:00100000:3.0:1776191804.252333:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191804.252909:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191804.252947:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191804.252987:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613823232
00000100:00100000:1.0:1776191804.253025:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613823296
00000100:00100000:1.0:1776191804.253071:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2193
00000100:00100000:1.0:1776191804.253076:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b28322 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613823232:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191804.253119:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b28322 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613823232:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 42us (786us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191804.253125:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2193
00000100:00100000:1.0:1776191804.253147:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2547
00000100:00100000:1.0:1776191804.253151:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000025f3deb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613823296:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:1.0:1776191804.253259:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191804.253285:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000025f3deb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613823296:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 132us (378us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191804.253291:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2547
00000100:00100000:0.0:1776191804.254505:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613823104
00000100:00100000:0.0:1776191804.254554:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613823168
00000100:00100000:2.0:1776191804.254567:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5128
00000100:00100000:2.0:1776191804.254572:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b69f705b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613823104:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191804.254644:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b69f705b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613823104:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 71us (3127us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191804.254652:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5128
00000100:00100000:0.0:1776191804.254680:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5129
00000100:00100000:0.0:1776191804.254685:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004a79b73d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613823168:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191804.254714:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004a79b73d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613823168:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 28us (1768us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191804.254720:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5129
00010000:00010000:3.0:1776191804.410736:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191805.434246:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191805.691600:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630982016:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191805.691667:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191805.692323:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630982016
00000100:00100000:3.0:1776191805.692382:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3485
00000100:00100000:3.0:1776191805.692387:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fae298a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630982016:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191805.692420:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191805.692728:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fae298a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630982016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 339us (1061us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191805.692736:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3485
00000100:00100000:0.0:1776191805.697618:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630982016:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191806.458493:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191806.715765:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191806.715998:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a0c5ca5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630982080:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191806.716089:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191806.716705:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630982080
00000100:00100000:0.0:1776191806.716886:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3486
00000100:00100000:0.0:1776191806.716893:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7cf3eab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630982080:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191806.716928:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191806.716991:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7cf3eab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630982080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (903us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191806.716998:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3486
00000100:00100000:2.0:1776191806.717089:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a0c5ca5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630982080:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191807.482243:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191807.738295:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e00c592 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630982144:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191807.738322:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191807.738338:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a98973d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630982208:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191807.738366:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191807.738432:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630982144
00000100:00100000:0.0:1776191807.738439:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191807.738487:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630982208
00000100:00100000:0.0:1776191807.738679:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1757
00000100:00100000:0.0:1776191807.738686:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cbd36cc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630982144:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191807.738715:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191807.738764:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cbd36cc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630982144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (399us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191807.738771:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1757
00000100:00100000:0.0:1776191807.738788:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1758
00000100:00100000:0.0:1776191807.738792:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000025ef566e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630982208:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191807.738802:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191807.738827:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000025ef566e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630982208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (390us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191807.738832:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1758
00000100:00080000:0.0:1776191807.738886:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191807.738891:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191807.738894:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191807.738898:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4340
00000100:00080000:0.0:1776191807.738901:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191807.738904:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191807.738919:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000008a7a5282 x1862467630982592/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191807.738932:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191807.738935:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191807.738936:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191807.738939:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4340
00000100:00080000:0.0:1776191807.738940:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191807.738949:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191807.738958:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000007d64d2e6 x1862467630982656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191807.738986:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008a7a5282 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630982592:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191807.739065:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191807.739083:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d64d2e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630982656:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191807.739106:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191807.739136:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630982592
00000100:00100000:0.0:1776191807.739159:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630982656
00000100:00100000:3.0:1776191807.739180:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008ff2a89a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630982400:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191807.739183:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2548
00000100:00100000:3.0:1776191807.739456:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191807.739576:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007670a2b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630982464:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191807.739610:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191807.739634:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:2.0:1776191807.739639:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d75056b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630982272:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191807.739664:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191807.739678:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008169e6c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630982528:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191807.739699:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004f4270fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630982336:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191807.739968:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000faf28487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630982592:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191807.740013:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191807.740048:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000a2092dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630982720:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191807.740088:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191807.740123:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630982464
00010000:02020000:0.0:1776191807.740152:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191807.740154:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630982336
00000100:00100000:0.0:1776191807.740208:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000faf28487 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630982592:12345-0@lo:8:kworker/u8:2.0 Request processed in 1017us (1174us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191807.740216:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2548
00000100:00100000:2.0:1776191807.740246:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630982720
00000100:00100000:2.0:1776191807.740284:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5130
00000100:00100000:2.0:1776191807.740288:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c5a025e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630982464:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191807.740336:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c5a025e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630982464:12345-0@lo:400:kworker/u8:2.0 Request processed in 46us (725us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191807.740344:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5130
00000100:00100000:0.0:1776191807.740392:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2549
00000100:00100000:0.0:1776191807.740397:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003e15780a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630982656:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191807.740421:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006503fab3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630982784:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191807.740447:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191807.740482:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630982784
00010000:02020000:0.0:1776191807.740489:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191807.740500:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e00c592 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630982144:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191807.740506:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5131
00000100:00100000:2.0:1776191807.740511:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d7dbbaf2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630982336:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191807.740523:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003e15780a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630982656:12345-0@lo:8:kworker/u8:2.0 Request processed in 124us (1416us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191807.740532:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2549
00000100:00100000:2.0:1776191807.740559:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d7dbbaf2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630982336:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (841us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191807.740565:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5132
00000100:00100000:0.0:1776191807.740570:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000069c1692e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630982720:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191807.740600:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000069c1692e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630982720:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (513us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191807.740606:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5132
00000100:00100000:0.0:1776191807.740620:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5133
00000100:00100000:0.0:1776191807.740630:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028296d2c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630982784:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191807.740630:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5131
00000100:00100000:0.0:1776191807.740670:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028296d2c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630982784:12345-0@lo:400:kworker/u8:2.0 Request processed in 42us (221us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191807.740672:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630982272
00000100:00100000:0.0:1776191807.740679:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5133
00000100:00100000:2.0:1776191807.740705:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1908
00000100:00100000:2.0:1776191807.740710:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d186bef1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630982272:12345-0@lo:400:kworker/u8:2.0
00000100:00080000:0.0:1776191807.740714:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191807.740719:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191807.740735:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008a7a5282 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630982592:0@lo:8:kworker/u8:2.0
00000100:00080000:0.0:1776191807.740745:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191807.740748:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191807.740750:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d64d2e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630982656:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191807.740775:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006503fab3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630982784:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191807.740852:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a98973d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630982208:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191807.740873:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191807.741010:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d186bef1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630982272:12345-0@lo:400:kworker/u8:2.0 Request processed in 299us (1345us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191807.741017:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1908
00000100:00100000:2.0:1776191807.741077:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004f4270fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630982336:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191807.741086:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000a2092dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630982720:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191807.746079:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630982400
00000100:00100000:1.0:1776191807.746176:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3487
00000100:00100000:1.0:1776191807.746183:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eb81ae79 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630982400:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191807.746297:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eb81ae79 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630982400:12345-0@lo:400:kworker/u8:2.0 Request processed in 114us (6842us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191807.746303:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3487
00000100:00100000:1.0:1776191807.746357:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008ff2a89a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630982400:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191807.752419:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630982528
00000100:00100000:3.0:1776191807.752499:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3488
00000100:00100000:3.0:1776191807.752505:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002a98973d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630982528:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191807.752570:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007670a2b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630982464:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191807.752572:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002a98973d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630982528:12345-0@lo:400:kworker/u8:2.0 Request processed in 65us (11698us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191807.752582:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3488
00000100:00100000:0.0:1776191807.752613:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d75056b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630982272:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191807.752624:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008169e6c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630982528:0@lo:400:kworker/u8:2.0
00010000:00010000:0.0:1776191808.506404:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191809.376428:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191809.376480:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191809.376527:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191809.376554:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191809.376714:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613823552
00000100:00100000:3.0:1776191809.376768:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2194
00000100:00100000:3.0:1776191809.376774:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d2e07ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613823552:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191809.376844:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d2e07ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613823552:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 69us (364us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191809.376851:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2194
00000100:00100000:0.0:1776191809.377417:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613823360
00000100:00100000:0.0:1776191809.377456:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1909
00000100:00100000:0.0:1776191809.377461:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000050bd026a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613823360:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191809.377499:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000050bd026a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613823360:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 37us (982us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191809.377505:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1909
00000100:00100000:2.0:1776191809.377640:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613823424
00000100:00100000:2.0:1776191809.377669:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613823488
00000100:00100000:2.0:1776191809.377702:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5134
00000100:00100000:2.0:1776191809.377707:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003ac71d2b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613823424:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191809.377737:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003ac71d2b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613823424:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 30us (1318us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191809.377743:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5134
00000100:00100000:2.0:1776191809.377757:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5135
00000100:00100000:2.0:1776191809.377761:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000062801b3d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613823488:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191809.377785:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000062801b3d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613823488:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 23us (1230us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191809.377790:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5135
00000100:00100000:2.0:1776191809.378914:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191809.379252:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613823616
00000100:00100000:0.0:1776191809.379293:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2550
00000100:00100000:0.0:1776191809.379300:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029e81afd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613823616:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:0.0:1776191809.379401:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191809.379458:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029e81afd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613823616:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 158us (549us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191809.379465:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2550
00010000:00010000:3.0:1776191809.530379:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191810.556334:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191810.810816:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1776191810.810834:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a426c55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630982848:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191810.810910:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191810.811028:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630982848
00000100:00100000:3.0:1776191810.811128:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3489
00000100:00100000:3.0:1776191810.811134:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c8cf6d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630982848:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191810.811168:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191810.811215:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c8cf6d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630982848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (306us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191810.811223:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3489
00000100:00100000:3.0:1776191810.811266:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a426c55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630982848:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191811.581311:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191811.834438:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191811.834453:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a0c5ca5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630982912:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191811.834533:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191811.834673:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630982912
00000100:00100000:2.0:1776191811.834715:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3490
00000100:00100000:2.0:1776191811.834720:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008169e6c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630982912:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191811.834750:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191811.834837:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008169e6c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630982912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (304us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191811.834844:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3490
00000100:00100000:0.0:1776191811.841615:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a0c5ca5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630982912:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191812.604368:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191812.858362:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e00c592 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630982976:0@lo:400:kworker/u8:4.0
00000100:00080000:3.0:1776191812.858374:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191812.858379:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191812.858383:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191812.858389:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4345
00000100:00080000:3.0:1776191812.858392:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191812.858398:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191812.858419:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000cd9107bd x1862467630983488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191812.858432:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1776191812.858437:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1776191812.858438:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191812.858441:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191812.858445:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4345
00000100:00080000:3.0:1776191812.858447:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191812.858451:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191812.858462:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000002a634854 x1862467630983552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191812.858464:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f784fad4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630983232:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191812.858495:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191812.858509:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc38b04d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630983168:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191812.858514:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000348ababd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630983616:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191812.858556:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191812.858558:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191812.858573:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [1->0]
00000100:00100000:2.0:1776191812.858581:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ac3eb660 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630983040:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191812.858584:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b65b7705 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630983424:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191812.858611:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191812.858624:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191812.858631:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b048c733 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630983296:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191812.858650:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:3.0:1776191812.858659:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a22f9ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630983104:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191812.858660:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191812.858686:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191812.858702:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ab2d9127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630983360:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191812.858729:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191812.858761:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630983232
00000100:00100000:3.0:1776191812.858762:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630983424
00000100:00100000:3.0:1776191812.858807:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630983360
00000100:00100000:1.0:1776191812.858810:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630983616
00000100:00100000:3.0:1776191812.858833:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2195
00000100:00100000:1.0:1776191812.858835:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630983104
00000100:00100000:3.0:1776191812.858841:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000085e6ba1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630983424:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191812.858857:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5136
00000100:00100000:1.0:1776191812.858862:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000924b81a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630983232:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191812.858899:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000085e6ba1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630983424:12345-0@lo:400:kworker/u8:4.0 Request processed in 58us (275us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191812.858905:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000924b81a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630983232:12345-0@lo:400:kworker/u8:4.0 Request processed in 42us (410us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191812.858909:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2195
00000100:00100000:1.0:1776191812.858916:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5136
00000100:00100000:3.0:1776191812.858929:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2196
00000100:00100000:3.0:1776191812.858934:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a98c80a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630983360:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191812.858955:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5137
00000100:00100000:1.0:1776191812.858960:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ae1da2b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630983616:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191812.858980:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a98c80a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630983360:12345-0@lo:400:kworker/u8:4.0 Request processed in 45us (250us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191812.858989:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2196
00000100:00100000:1.0:1776191812.858994:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ae1da2b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630983616:12345-0@lo:400:kworker/u8:4.0 Request processed in 32us (442us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191812.859001:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5137
00000100:00100000:3.0:1776191812.859015:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5138
00000100:00100000:3.0:1776191812.859021:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f485f4a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630983104:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191812.859097:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d75056b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630983744:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191812.859124:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191812.859156:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cd9107bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630983488:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191812.859178:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191812.859193:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a634854 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630983552:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191812.859211:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191812.859238:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630982976
00000100:00100000:0.0:1776191812.859265:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1910
00000100:00100000:0.0:1776191812.859269:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008cbd400d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630982976:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191812.859300:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008cbd400d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630982976:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (868us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191812.859306:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1910
00000100:00100000:0.0:1776191812.859335:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630983488
00000100:00100000:0.0:1776191812.859352:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630983552
00000100:00100000:0.0:1776191812.859360:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551
00000100:00100000:0.0:1776191812.859364:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006503fab3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630983488:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191812.859457:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191812.860070:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b2bebc0b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630983680:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191812.860106:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191812.860139:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000348ababd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630983616:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191812.860150:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f784fad4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630983232:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191812.860157:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e00c592 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630982976:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191812.860193:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630983680
00000100:00100000:3.0:1776191812.863148:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f485f4a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630983104:12345-0@lo:400:kworker/u8:4.0 Request processed in 4122us (4458us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191812.863333:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630983040
00000100:00100000:1.0:1776191812.864240:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630983744
00000100:00100000:1.0:1776191812.864277:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1759
00000100:00100000:1.0:1776191812.864283:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ee2fc84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630983040:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191812.864309:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191812.864364:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ee2fc84 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630983040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (5753us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191812.864370:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1759
00000100:00100000:1.0:1776191812.864386:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1760
00000100:00100000:1.0:1776191812.864389:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007670a2b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630983744:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191812.864398:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191812.864422:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007670a2b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630983744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (5298us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191812.864430:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1760
00000100:00100000:1.0:1776191812.864453:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2552
00000100:00100000:1.0:1776191812.864457:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d64d2e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630983552:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191812.864556:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191812.864591:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d64d2e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630983552:12345-0@lo:8:kworker/u8:4.0 Request processed in 133us (5379us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191812.864596:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2552
00000100:00100000:1.0:1776191812.864662:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d75056b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630983744:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1776191812.864869:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191812.864874:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191812.864878:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a634854 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630983552:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191812.865149:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630983168
00000100:00100000:1.0:1776191812.865180:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630983296
00000100:00100000:1.0:1776191812.865194:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3491
00000100:00100000:1.0:1776191812.865198:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa08bf51 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630983168:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191812.865239:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa08bf51 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630983168:12345-0@lo:400:kworker/u8:4.0 Request processed in 40us (6688us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191812.865245:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3491
00000100:00100000:1.0:1776191812.865255:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3492
00000100:00100000:1.0:1776191812.865258:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000076ea9d35 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630983296:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191812.865283:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000076ea9d35 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630983296:12345-0@lo:400:kworker/u8:4.0 Request processed in 24us (6626us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191812.865289:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3492
00000100:00100000:1.0:1776191812.865324:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ac3eb660 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630983040:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191812.865335:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b048c733 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630983296:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191812.865386:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a22f9ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630983104:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191812.865398:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ab2d9127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630983360:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191812.865407:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc38b04d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630983168:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191812.865415:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b65b7705 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630983424:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191812.865529:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5139
00000100:00100000:2.0:1776191812.865534:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007c4b8263 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630983680:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191812.865577:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007c4b8263 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630983680:12345-0@lo:400:kworker/u8:4.0 Request processed in 42us (5472us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191812.865583:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5139
00000100:00100000:2.0:1776191812.865607:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b2bebc0b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630983680:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191812.868532:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5138
00000100:00100000:0.0:1776191812.887248:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006503fab3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630983488:12345-0@lo:8:kworker/u8:4.0 Request processed in 27875us (28062us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191812.887263:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551
00000100:00080000:2.0:1776191812.887868:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191812.887874:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191812.887880:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cd9107bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630983488:0@lo:8:kworker/u8:4.0
00010000:00010000:3.0:1776191813.626440:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191814.490830:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191814.490943:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191814.490982:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191814.491007:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191814.491031:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191814.491121:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613823808
00000100:00100000:3.0:1776191814.491168:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613823744
00000100:00100000:3.0:1776191814.491188:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5140
00000100:00100000:3.0:1776191814.491194:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009273e03a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613823808:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191814.491279:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009273e03a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613823808:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 84us (336us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191814.491287:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5140
00000100:00100000:3.0:1776191814.491303:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5141
00000100:00100000:3.0:1776191814.491307:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2c32111 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613823744:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191814.491333:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2c32111 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613823744:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 25us (351us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191814.491339:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5141
00000100:00100000:3.0:1776191814.491368:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613823872
00000100:00100000:3.0:1776191814.491403:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613823936
00000100:00100000:3.0:1776191814.491419:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2197
00000100:00100000:3.0:1776191814.491423:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a1da7374 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613823872:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191814.491448:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a1da7374 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613823872:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 25us (442us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191814.491454:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2197
00000100:00100000:3.0:1776191814.491466:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2553
00000100:00100000:3.0:1776191814.491469:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd9107bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613823936:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:3.0:1776191814.491558:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191814.491583:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd9107bd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613823936:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 113us (552us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191814.491589:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2553
00000100:00100000:1.0:1776191814.494512:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613823680
00000100:00100000:1.0:1776191814.494640:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1911
00000100:00100000:1.0:1776191814.494648:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000afc79a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613823680:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191814.494735:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000afc79a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613823680:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 87us (3913us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191814.494742:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1911
00010000:00010000:0.0:1776191814.651197:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191815.674969:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191815.930388:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1776191815.930405:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630983808:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191815.930486:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191815.930601:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630983808
00000100:00100000:1.0:1776191815.930656:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3493
00000100:00100000:1.0:1776191815.930662:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000352f4840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630983808:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191815.930694:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191815.930749:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000352f4840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630983808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (263us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191815.930756:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3493
00000100:00100000:0.0:1776191815.931302:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630983808:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191816.698419:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191816.957168:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043c46f30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630983872:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191816.957353:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191816.958019:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630983872
00000100:00100000:1.0:1776191816.958096:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3494
00000100:00100000:1.0:1776191816.958103:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ab16a8b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630983872:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191816.958143:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191816.958205:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ab16a8b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630983872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (854us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191816.958211:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3494
00000100:00100000:3.0:1776191816.958388:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000043c46f30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630983872:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191817.722411:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1776191817.978249:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191817.978255:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191817.978258:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191817.978266:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4350
00000100:00080000:3.0:1776191817.978270:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191817.978276:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191817.978295:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000005e00c592 x1862467630984384/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191817.978309:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191817.978312:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191817.978313:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191817.978316:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4350
00000100:00080000:3.0:1776191817.978317:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191817.978320:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191817.978340:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000f784fad4 x1862467630984448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191817.978378:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc38b04d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630984064:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191817.978440:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191817.978466:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a634854 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630984320:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191817.978500:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191817.978521:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:3.0:1776191817.978526:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b65b7705 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630984000:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191817.978551:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191817.978564:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b048c733 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630984256:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191817.978575:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630984064
00000100:00100000:3.0:1776191817.978580:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191817.978606:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630984320
00000100:00100000:1.0:1776191817.978614:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3495
00000100:00100000:1.0:1776191817.978620:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b28322 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630984064:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191817.978628:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630984256
00000100:00100000:3.0:1776191817.978640:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2198
00000100:00100000:3.0:1776191817.978644:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000025f3deb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630984320:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191817.978712:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ab2d9127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630984128:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191817.978790:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b2bebc0b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630983936:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191817.981614:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000025f3deb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630984320:12345-0@lo:400:kworker/u8:4.0 Request processed in 2961us (3106us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191817.981629:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2198
00000100:00100000:3.0:1776191817.981665:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2199
00000100:00100000:3.0:1776191817.981673:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d1c8a441 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630984256:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191817.981761:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d1c8a441 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630984256:12345-0@lo:400:kworker/u8:4.0 Request processed in 88us (3179us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191817.981767:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2199
00000100:00100000:3.0:1776191817.982589:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e00c592 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630984384:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191817.982641:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191817.982662:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f784fad4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630984448:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191817.982683:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191817.982733:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630984384
00000100:00100000:3.0:1776191817.982758:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630984448
00000100:00100000:3.0:1776191817.982781:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2554
00000100:00100000:3.0:1776191817.982786:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b847a9ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630984384:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191817.982915:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191817.982949:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b847a9ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630984384:12345-0@lo:8:kworker/u8:4.0 Request processed in 163us (308us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191817.982956:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2554
00000100:00100000:3.0:1776191817.982970:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2555
00000100:00100000:3.0:1776191817.982973:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027e578e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630984448:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191817.983078:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191817.983822:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027e578e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630984448:12345-0@lo:8:kworker/u8:4.0 Request processed in 844us (1135us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191817.984235:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2555
00000100:00080000:3.0:1776191817.984300:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191817.984305:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191817.984309:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e00c592 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630984384:0@lo:8:kworker/u8:4.0
00000100:00080000:3.0:1776191817.984319:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191817.984321:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191817.984324:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f784fad4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630984448:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191817.984537:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630984000
00000100:00100000:3.0:1776191817.984578:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5142
00000100:00100000:3.0:1776191817.984583:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000023dd469f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630984000:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191817.984648:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000023dd469f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630984000:12345-0@lo:400:kworker/u8:4.0 Request processed in 64us (6096us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191817.984655:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5142
00000100:00100000:3.0:1776191817.984721:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000af172616 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630984640:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191817.984753:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191817.984787:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630984640
00000100:00100000:3.0:1776191817.984809:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1761
00000100:00100000:3.0:1776191817.984813:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f784fad4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630984640:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191817.984848:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191817.984882:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f784fad4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630984640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (129us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191817.984887:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1761
00000100:00100000:3.0:1776191817.984929:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000af172616 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630984640:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191817.984959:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b65b7705 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630984000:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191817.984970:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b048c733 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630984256:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191817.984981:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc38b04d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630984064:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191817.984989:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a634854 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630984320:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191817.985077:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1776191817.985084:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a634854 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630984704:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191817.985118:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191817.985139:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630984704
00000100:00100000:3.0:1776191817.985159:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1762
00000100:00100000:3.0:1776191817.985163:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc38b04d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630984704:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191817.985175:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191817.985202:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc38b04d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630984704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (84us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191817.985207:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1762
00000100:00100000:3.0:1776191817.985229:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a634854 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630984704:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191817.985967:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b28322 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630984064:12345-0@lo:400:kworker/u8:4.0 Request processed in 7343us (7523us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191817.985977:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3495
00000100:00100000:2.0:1776191817.986107:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191817.986137:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000348ababd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630984512:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191817.986165:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191817.986254:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630984128
00000100:00100000:1.0:1776191817.986288:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630984512
00000100:00100000:1.0:1776191817.986308:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5143
00000100:00100000:1.0:1776191817.986312:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000785d411c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630984128:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191817.986359:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000785d411c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630984128:12345-0@lo:400:kworker/u8:4.0 Request processed in 46us (253us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191817.986365:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5143
00000100:00100000:1.0:1776191817.986376:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5144
00000100:00100000:1.0:1776191817.986380:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009f8cb77f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630984512:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191817.986415:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009f8cb77f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630984512:12345-0@lo:400:kworker/u8:4.0 Request processed in 34us (249us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191817.986420:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5144
00000100:00100000:2.0:1776191817.986567:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ab2d9127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630984128:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191817.986578:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000348ababd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630984512:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191817.989173:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191817.989224:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a22f9ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630984192:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191817.989268:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191817.989281:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002e3e1154 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630984576:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191817.989301:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191817.989458:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630983936
00000100:00100000:1.0:1776191817.990345:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630984192
00000100:00100000:1.0:1776191817.990416:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3496
00000100:00100000:1.0:1776191817.990430:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a7a5282 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630984192:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191817.990502:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a7a5282 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630984192:12345-0@lo:400:kworker/u8:4.0 Request processed in 79us (1234us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191817.990513:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3496
00000100:00100000:2.0:1776191817.990681:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630984576
00000100:00100000:2.0:1776191817.990718:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5145
00000100:00100000:2.0:1776191817.990721:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001129c7cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630984576:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191817.990751:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a22f9ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630984192:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191817.990755:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001129c7cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630984576:12345-0@lo:400:kworker/u8:4.0 Request processed in 33us (1454us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191817.990761:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5145
00000100:00100000:0.0:1776191817.990763:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002e3e1154 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630984576:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191817.990977:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1912
00000100:00100000:3.0:1776191817.990982:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003026b1b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630983936:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191817.991448:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003026b1b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630983936:12345-0@lo:400:kworker/u8:4.0 Request processed in 464us (2282us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191817.991456:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1912
00000100:00100000:2.0:1776191817.997519:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b2bebc0b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630983936:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191818.747650:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191819.612405:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191819.612449:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191819.612492:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191819.612505:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613824064
00000100:00100000:3.0:1776191819.612540:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191819.612599:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613824000
00000100:00100000:0.0:1776191819.612616:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613824192
00000100:00100000:1.0:1776191819.612635:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1913
00000100:00100000:1.0:1776191819.612643:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be2451ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613824000:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191819.612657:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2200
00000100:00100000:0.0:1776191819.612663:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b048c733 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613824192:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191819.613113:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be2451ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613824000:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 457us (610us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191819.613123:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1913
00000100:00100000:0.0:1776191819.616945:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b048c733 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613824192:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 4273us (4488us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191819.616974:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2200
00000100:00100000:2.0:1776191819.619074:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613824128
00000100:00100000:3.0:1776191819.619138:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191819.619155:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5146
00000100:00100000:3.0:1776191819.619175:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613824256
00000100:00100000:3.0:1776191819.619197:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2556
00000100:00100000:3.0:1776191819.619202:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e00c592 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613824256:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00000100:00100000:2.0:1776191819.619243:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002a634854 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613824064:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191819.619307:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002a634854 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613824064:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 66us (6911us total) trans 0 rc 0/0
00010000:02020000:3.0:1776191819.619313:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191819.619320:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5146
00000100:00100000:3.0:1776191819.619346:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e00c592 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613824256:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 142us (212us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191819.619353:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2556
00000100:00100000:2.0:1776191819.619649:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5147
00000100:00100000:2.0:1776191819.619654:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b65b7705 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613824128:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191819.619683:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b65b7705 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613824128:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 29us (7146us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191819.619689:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5147
00010000:00010000:3.0:1776191819.770279:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191820.796901:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191821.051328:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1776191821.051345:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aaba3ebf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630984768:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191821.051416:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191821.051634:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630984768
00000100:00100000:1.0:1776191821.051691:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3497
00000100:00100000:1.0:1776191821.051698:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b37332da pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630984768:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191821.051731:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191821.051884:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b37332da pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630984768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 185us (469us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191821.051892:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3497
00000100:00100000:0.0:1776191821.052262:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aaba3ebf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630984768:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191821.820695:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191822.078072:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086a13048 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630984832:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191822.078149:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191822.078470:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630984832
00000100:00100000:2.0:1776191822.078564:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3498
00000100:00100000:2.0:1776191822.078571:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b40a82ac pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630984832:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191822.078603:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191822.078714:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b40a82ac pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630984832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (565us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191822.078720:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3498
00000100:00100000:0.0:1776191822.079333:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086a13048 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630984832:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191822.842230:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191823.098330:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1776191823.098353:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b2bebc0b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630984896:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191823.098422:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191823.098530:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630984896
00000100:00100000:1.0:1776191823.098576:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1763
00000100:00100000:1.0:1776191823.098582:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e3e1154 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630984896:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191823.098610:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191823.098654:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e3e1154 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630984896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (233us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191823.098673:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1763
00000100:00080000:1.0:1776191823.098751:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191823.098755:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191823.098758:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191823.098763:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4356
00000100:00080000:1.0:1776191823.098766:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191823.098769:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191823.098788:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000a96a54e5 x1862467630985344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191823.098805:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191823.098808:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191823.098809:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191823.098811:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4356
00000100:00080000:1.0:1776191823.098813:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191823.098817:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191823.098827:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000003f4bfd6c x1862467630985408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191823.098860:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086a13048 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630984960:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191823.098902:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191823.098920:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a0c5ca5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630985216:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191823.098941:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191823.098971:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b2bebc0b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630984896:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191823.098987:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:1.0:1776191823.098992:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630985152:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191823.099016:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191823.099029:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017fc0dbf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630985536:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191823.099079:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191823.099104:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630984960
00000100:00100000:1.0:1776191823.099129:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1914
00000100:00100000:1.0:1776191823.099133:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f9c8ab18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630984960:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191823.099165:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f9c8ab18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630984960:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (264us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191823.099171:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1914
00000100:00100000:1.0:1776191823.099192:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630985152
00000100:00100000:1.0:1776191823.099211:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630985536
00000100:00100000:1.0:1776191823.099227:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5148
00000100:00100000:1.0:1776191823.099230:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000033b3f754 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630985152:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191823.099258:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000033b3f754 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630985152:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (242us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191823.099264:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5148
00000100:00100000:1.0:1776191823.099273:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5149
00000100:00100000:1.0:1776191823.099277:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000038b90f22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630985536:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191823.099283:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043c46f30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630985088:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191823.099301:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000038b90f22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630985536:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (222us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191823.099306:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5149
00000100:00100000:0.0:1776191823.099311:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191823.099332:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630985152:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191823.099341:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017fc0dbf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630985536:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191823.099344:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630985216
00000100:00100000:1.0:1776191823.099347:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086a13048 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630984960:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191823.099364:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630985088
00000100:00100000:1.0:1776191823.099367:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aaba3ebf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630985024:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191823.099374:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3499
00000100:00100000:0.0:1776191823.099378:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006df8bd7e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630985216:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191823.099388:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191823.099404:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006df8bd7e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630985216:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (463us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191823.099405:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630985024
00000100:00100000:0.0:1776191823.099410:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3499
00000100:00100000:0.0:1776191823.099420:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3500
00000100:00100000:1.0:1776191823.099422:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5150
00000100:00100000:0.0:1776191823.099424:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049d8d6b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630985088:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191823.099424:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000017fc0dbf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630985024:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191823.099446:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049d8d6b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630985088:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (135us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191823.099446:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000017fc0dbf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630985024:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (58us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191823.099453:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3500
00000100:00100000:1.0:1776191823.099453:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5150
00000100:00100000:1.0:1776191823.099466:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a426c55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630985280:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191823.099474:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a0c5ca5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630985216:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191823.099487:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191823.099488:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008826861 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630985472:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191823.099507:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aaba3ebf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630985024:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191823.099508:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191823.099533:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630985472
00000100:00100000:1.0:1776191823.099553:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5151
00000100:00100000:1.0:1776191823.099556:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000064082750 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630985472:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191823.099583:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000064082750 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630985472:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (75us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191823.099589:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5151
00000100:00100000:0.0:1776191823.099740:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000043c46f30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630985088:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191823.099749:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008826861 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630985472:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191823.100838:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630985280
00000100:00100000:2.0:1776191823.100879:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2201
00000100:00100000:2.0:1776191823.100888:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ebbe68e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630985280:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191823.100936:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e63aab7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630985600:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191823.100951:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ebbe68e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630985280:12345-0@lo:400:kworker/u8:2.0 Request processed in 63us (1464us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191823.100957:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2201
00000100:00100000:0.0:1776191823.100966:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191823.101110:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630985600
00000100:00100000:3.0:1776191823.101143:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1764
00000100:00100000:3.0:1776191823.101147:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d2780f83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630985600:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191823.101160:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191823.101201:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d2780f83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630985600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (234us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191823.101207:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1764
00000100:00100000:3.0:1776191823.101225:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a96a54e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630985344:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191823.101244:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e63aab7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630985600:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191823.101248:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191823.101262:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003f4bfd6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630985408:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191823.101280:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191823.101290:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630985344
00000100:00100000:3.0:1776191823.101299:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630985408
00000100:00100000:0.0:1776191823.101309:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557
00000100:00100000:3.0:1776191823.101312:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2558
00000100:00100000:0.0:1776191823.101313:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004a22f9ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630985344:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191823.101315:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000348ababd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630985408:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191823.101517:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:02020000:0.0:1776191823.101524:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191823.101877:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a426c55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630985280:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191823.101966:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000348ababd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630985408:12345-0@lo:8:kworker/u8:2.0 Request processed in 649us (685us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191823.101973:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2558
00000100:00100000:0.0:1776191823.105257:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004a22f9ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630985344:12345-0@lo:8:kworker/u8:2.0 Request processed in 3935us (4000us total) trans 0 rc -19/-19
00000100:00080000:3.0:1776191823.105257:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1776191823.105273:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557
00000100:00080000:3.0:1776191823.105274:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191823.105282:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a96a54e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630985344:0@lo:8:kworker/u8:2.0
00000100:00080000:3.0:1776191823.105300:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191823.105303:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191823.105305:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003f4bfd6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630985408:0@lo:8:kworker/u8:2.0
00010000:00010000:0.0:1776191823.866312:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191824.731903:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191824.731947:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191824.732103:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613824320
00000100:00100000:2.0:1776191824.732156:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1915
00000100:00100000:2.0:1776191824.732163:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081b9520e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613824320:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191824.732242:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081b9520e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613824320:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 78us (347us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191824.732249:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1915
00000100:00100000:3.0:1776191824.733952:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191824.733991:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191824.734154:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613824512
00000100:00100000:2.0:1776191824.734201:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2202
00000100:00100000:2.0:1776191824.734208:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b2bebc0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613824512:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191824.734270:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b2bebc0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613824512:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 61us (322us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191824.734367:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2202
00000100:00100000:1.0:1776191824.742072:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613824384
00000100:00100000:3.0:1776191824.742130:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191824.742142:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5152
00000100:00100000:1.0:1776191824.742770:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ab2d9127 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613824384:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191824.742851:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ab2d9127 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613824384:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 257us (10905us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191824.742859:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5152
00000100:00100000:1.0:1776191824.742886:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613824448
00000100:00100000:3.0:1776191824.743715:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613824576
00000100:00100000:1.0:1776191824.743766:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5153
00000100:00100000:1.0:1776191824.743775:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003f4bfd6c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613824448:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191824.743785:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2559
00000100:00100000:3.0:1776191824.743792:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a96a54e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613824576:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00000100:00100000:1.0:1776191824.743837:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003f4bfd6c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613824448:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 63us (9846us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191824.743845:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5153
00010000:02020000:3.0:1776191824.743885:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191824.743912:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a96a54e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613824576:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 121us (1787us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191824.743919:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2559
00010000:00010000:3.0:1776191824.890713:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191825.914255:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191826.172620:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191826.172639:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000354fd625 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630985664:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191826.172715:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191826.172931:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630985664
00000100:00100000:0.0:1776191826.172983:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3501
00000100:00100000:0.0:1776191826.172989:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af172616 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630985664:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191826.173030:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191826.173103:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af172616 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630985664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (389us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191826.173111:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3501
00000100:00100000:1.0:1776191826.173651:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000354fd625 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630985664:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191826.941561:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191827.194671:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000354fd625 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630985728:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191827.194740:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191827.194859:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630985728
00000100:00100000:2.0:1776191827.194905:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3502
00000100:00100000:2.0:1776191827.194912:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005fd6c919 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630985728:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191827.194942:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191827.194994:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005fd6c919 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630985728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (255us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191827.195001:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3502
00000100:00100000:3.0:1776191827.195118:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000354fd625 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630985728:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191827.962358:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191828.218453:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000746b7981 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630985792:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191828.218523:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191828.218632:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630985792
00000100:00100000:1.0:1776191828.218684:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1765
00000100:00100000:1.0:1776191828.218690:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e63aab7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630985792:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191828.218722:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00080000:0.0:1776191828.218731:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191828.218737:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191828.218740:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191828.218746:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4361
00000100:00080000:0.0:1776191828.218748:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191828.218753:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191828.218765:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e63aab7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630985792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (243us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191828.218774:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000004f4270fe x1862467630986240/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191828.218780:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1765
00000100:00080000:0.0:1776191828.218793:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191828.218796:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191828.218798:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191828.218801:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4361
00000100:00080000:0.0:1776191828.218804:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:0.0:1776191828.218807:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191828.218818:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000d0c84519 x1862467630986304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191828.218822:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a30924b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630985856:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191828.218863:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040075bf1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630985920:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191828.218864:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191828.218885:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008ff2a89a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630986112:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191828.218902:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191828.218919:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191828.218925:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000a2092dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630986176:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191828.218943:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:1.0:1776191828.218950:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d75056b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630986048:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191828.218954:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191828.218975:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:0.0:1776191828.218980:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000296e59aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630985984:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191828.218996:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191828.219082:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004f4270fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630986240:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191828.219132:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630985856
00000100:00100000:2.0:1776191828.219159:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1916
00000100:00100000:2.0:1776191828.219163:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b0b64a4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630985856:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191828.220167:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009916a1d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630986432:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191828.220209:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191828.220238:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000070835139 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630986496:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191828.220259:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191828.220413:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191828.220441:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea373370 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630986368:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191828.220459:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630986112
00000100:00100000:0.0:1776191828.220468:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191828.220495:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630985984
00000100:00100000:1.0:1776191828.220511:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3503
00000100:00100000:0.0:1776191828.220515:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630985920
00000100:00100000:1.0:1776191828.220516:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1b66093 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630986112:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191828.220548:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630986048
00000100:00100000:1.0:1776191828.220565:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1b66093 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630986112:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (1646us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191828.220573:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3503
00000100:00100000:0.0:1776191828.220574:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630986432
00000100:00100000:1.0:1776191828.220592:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3504
00000100:00100000:0.0:1776191828.220598:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630986368
00000100:00100000:1.0:1776191828.220598:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002599c576 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630985984:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191828.220632:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5154
00000100:00100000:0.0:1776191828.220636:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003135151f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630985920:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191828.220915:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003135151f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630985920:12345-0@lo:400:kworker/u8:2.0 Request processed in 277us (2014us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191828.220923:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5154
00000100:00100000:0.0:1776191828.220935:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5155
00000100:00100000:0.0:1776191828.220939:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000871997a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630986048:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191828.220980:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000871997a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630986048:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (1986us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191828.220990:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5155
00000100:00100000:0.0:1776191828.221003:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5156
00000100:00100000:0.0:1776191828.221006:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000040035503 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630986432:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191828.221050:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000040035503 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630986432:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (823us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191828.221056:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5156
00000100:00100000:0.0:1776191828.221069:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5157
00000100:00100000:0.0:1776191828.221073:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f2c8d2dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630986368:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191828.221097:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f2c8d2dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630986368:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (629us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191828.221102:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5157
00000100:00100000:0.0:1776191828.221156:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea373370 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630986368:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191828.221168:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040075bf1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630985920:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191828.221227:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630986496
00000100:00100000:0.0:1776191828.221252:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1766
00000100:00100000:0.0:1776191828.221256:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d799a936 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630986496:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191828.221270:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191828.221298:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d799a936 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630986496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (1039us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191828.221303:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1766
00000100:00100000:0.0:1776191828.221346:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000070835139 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630986496:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191828.221358:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d75056b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630986048:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191828.221367:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009916a1d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630986432:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191828.221379:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008ff2a89a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630986112:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191828.221439:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000746b7981 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630985792:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191828.221484:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191828.221494:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002599c576 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630985984:12345-0@lo:400:kworker/u8:2.0 Request processed in 896us (1081us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191828.221501:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3504
00000100:00100000:3.0:1776191828.221502:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d0c84519 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630986304:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191828.221525:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191828.221528:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000296e59aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630985984:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191828.221572:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b0b64a4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630985856:12345-0@lo:400:kworker/u8:2.0 Request processed in 2404us (2707us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191828.221573:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630986176
00000100:00100000:2.0:1776191828.221583:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1916
00000100:00100000:2.0:1776191828.221632:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a30924b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630985856:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191828.221657:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630986240
00000100:00100000:2.0:1776191828.221672:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2203
00000100:00100000:2.0:1776191828.221676:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc54e5ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630986176:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191828.221703:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc54e5ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630986176:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (2752us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191828.221709:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2203
00000100:00100000:2.0:1776191828.221718:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560
00000100:00100000:2.0:1776191828.221721:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027f5d17c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630986240:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191828.221807:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191828.221827:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027f5d17c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630986240:12345-0@lo:8:kworker/u8:2.0 Request processed in 105us (345us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191828.221831:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560
00000100:00100000:0.0:1776191828.221892:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000a2092dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630986176:0@lo:400:kworker/u8:2.0
00000100:00080000:3.0:1776191828.221956:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191828.221960:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191828.221963:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004f4270fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630986240:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191828.222001:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630986304
00000100:00100000:2.0:1776191828.222154:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561
00000100:00100000:2.0:1776191828.222158:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070835139 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630986304:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191828.222253:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191828.222499:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070835139 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630986304:12345-0@lo:8:kworker/u8:2.0 Request processed in 339us (972us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191828.222505:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561
00000100:00080000:3.0:1776191828.222571:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191828.222574:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191828.222577:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0c84519 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630986304:0@lo:8:kworker/u8:2.0
00010000:00010000:3.0:1776191828.986298:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191829.852140:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191829.852243:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191829.852415:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613824704
00000100:00100000:0.0:1776191829.852475:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5158
00000100:00100000:0.0:1776191829.852482:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d71ef7e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613824704:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191829.852561:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d71ef7e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613824704:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 78us (317us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191829.852568:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5158
00000100:00100000:3.0:1776191829.854603:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191829.854643:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191829.854679:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191829.854767:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613824832
00000100:00100000:1.0:1776191829.854818:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613824896
00000100:00100000:1.0:1776191829.854841:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2204
00000100:00100000:1.0:1776191829.854848:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b044802b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613824832:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191829.854926:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b044802b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613824832:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 77us (331us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191829.854935:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2204
00000100:00100000:1.0:1776191829.854955:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2562
00000100:00100000:1.0:1776191829.854958:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004905ea34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613824896:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00000100:00100000:2.0:1776191829.855074:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613824640
00000100:00100000:2.0:1776191829.855103:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1917
00000100:00100000:2.0:1776191829.855108:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085b2d193 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613824640:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191829.855138:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085b2d193 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613824640:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 28us (3005us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191829.855144:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1917
00000100:00100000:2.0:1776191829.855205:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613824768
00000100:00100000:2.0:1776191829.855228:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5159
00000100:00100000:2.0:1776191829.855232:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000083657c43 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613824768:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191829.855260:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000083657c43 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613824768:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 27us (581us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191829.855267:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5159
00010000:02020000:1.0:1776191829.855415:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191829.855453:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004905ea34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613824896:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 492us (809us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191829.855461:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2562
00010000:00010000:0.0:1776191830.010257:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191831.035970:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191831.293028:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191831.293068:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ade5f5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630986560:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191831.293147:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191831.293220:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630986560
00000100:00100000:0.0:1776191831.293274:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3505
00000100:00100000:0.0:1776191831.293281:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000635a6f18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630986560:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191831.293313:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191831.293376:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000635a6f18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630986560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (230us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191831.293383:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3505
00000100:00100000:3.0:1776191831.293580:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ade5f5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630986560:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191832.058249:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191832.316063:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000500f9601 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630986624:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191832.316134:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191832.316362:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630986624
00000100:00100000:1.0:1776191832.316412:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3506
00000100:00100000:1.0:1776191832.316417:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bedc80a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630986624:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191832.316448:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191832.316498:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bedc80a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630986624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (365us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191832.316506:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3506
00000100:00100000:3.0:1776191832.316593:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000500f9601 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630986624:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191833.082238:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1776191833.338344:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191833.338351:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191833.338355:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191833.338363:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4366
00000100:00080000:1.0:1776191833.338366:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191833.338371:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191833.338391:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000003a0c5ca5 x1862467630987200/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191833.338404:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191833.338420:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191833.338421:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191833.338424:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4366
00000100:00080000:1.0:1776191833.338426:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191833.338435:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191833.338447:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000086a13048 x1862467630987264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191833.338544:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000061b94ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630986752:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191833.338612:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191833.338637:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a426c55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630987008:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191833.338663:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191833.338683:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [2->3]
00000100:00100000:2.0:1776191833.338689:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007a366bf6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630986688:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191833.338711:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191833.338726:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008826861 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630986944:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191833.338747:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191833.338763:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630987328:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191833.338785:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191833.338930:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630986752
00000100:00100000:2.0:1776191833.338977:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1918
00000100:00100000:2.0:1776191833.338984:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cef7ed6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630986752:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191833.338998:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000500f9601 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630986816:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191833.339059:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191833.339063:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cef7ed6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630986752:12345-0@lo:400:kworker/u8:4.0 Request processed in 77us (451us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191833.339067:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000354fd625 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630986880:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191833.339075:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1918
00000100:00100000:1.0:1776191833.339079:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043c46f30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630987072:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191833.339098:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191833.339102:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191833.339116:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aaba3ebf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630987136:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191833.339120:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d808a8bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630987456:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191833.339121:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630987008
00000100:00100000:1.0:1776191833.339140:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191833.339140:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191833.339146:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630986880
00000100:00100000:2.0:1776191833.339167:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3507
00000100:00100000:2.0:1776191833.339171:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ac3eb660 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630987008:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191833.339174:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a0c5ca5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630987200:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191833.339208:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191833.339214:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ac3eb660 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630987008:12345-0@lo:400:kworker/u8:4.0 Request processed in 42us (551us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191833.339225:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3507
00000100:00100000:3.0:1776191833.339227:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086a13048 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630987264:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191833.339242:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3508
00000100:00100000:2.0:1776191833.339247:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f947cdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630986880:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191833.339252:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191833.339290:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f947cdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630986880:12345-0@lo:400:kworker/u8:4.0 Request processed in 42us (192us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191833.339296:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3508
00000100:00100000:2.0:1776191833.339319:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630986688
00000100:00100000:0.0:1776191833.339342:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630986944
00000100:00100000:0.0:1776191833.339371:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630987328
00000100:00100000:0.0:1776191833.339389:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630986816
00000100:00100000:0.0:1776191833.339406:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5160
00000100:00100000:0.0:1776191833.339410:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002d7eb8c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630986944:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191833.339447:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002d7eb8c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630986944:12345-0@lo:400:kworker/u8:4.0 Request processed in 35us (699us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191833.339453:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5160
00000100:00100000:0.0:1776191833.339465:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5161
00000100:00100000:0.0:1776191833.339468:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be243e0e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630987328:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191833.339517:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be243e0e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630987328:12345-0@lo:400:kworker/u8:4.0 Request processed in 47us (731us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191833.339523:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5161
00000100:00100000:0.0:1776191833.339534:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5162
00000100:00100000:0.0:1776191833.339537:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa646f87 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630986816:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191833.339561:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa646f87 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630986816:12345-0@lo:400:kworker/u8:4.0 Request processed in 22us (503us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191833.339566:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5162
00000100:00100000:1.0:1776191833.340876:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000500f9601 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630986816:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191833.340982:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1776191833.340995:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053bdf8f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630987392:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191833.341066:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630987456
00000100:00100000:1.0:1776191833.341067:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191833.341102:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630987392
00000100:00100000:3.0:1776191833.341123:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630987072
00000100:00100000:1.0:1776191833.341133:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5163
00000100:00100000:1.0:1776191833.341140:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d7848e1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630987392:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191833.341155:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630987136
00000100:00100000:3.0:1776191833.341175:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630987200
00000100:00100000:3.0:1776191833.341189:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630987264
00000100:00100000:1.0:1776191833.341201:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d7848e1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630987392:12345-0@lo:400:kworker/u8:4.0 Request processed in 60us (135us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191833.341203:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2205
00000100:00100000:3.0:1776191833.341210:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008074d522 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630987072:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191833.341214:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5163
00000100:00100000:1.0:1776191833.341249:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053bdf8f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630987392:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191833.341276:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008074d522 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630987072:12345-0@lo:400:kworker/u8:4.0 Request processed in 66us (2172us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191833.341283:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2205
00000100:00100000:1.0:1776191833.341285:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008826861 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630986944:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191833.341301:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2206
00000100:00100000:3.0:1776191833.341305:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003135b5de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3364:x1862467630987136:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191833.341314:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630987328:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191833.341330:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000061b94ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630986752:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191833.341342:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003135b5de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3364:x1862467630987136:12345-0@lo:400:kworker/u8:4.0 Request processed in 34us (2202us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191833.341348:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a426c55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630987008:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191833.341350:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2206
00000100:00100000:3.0:1776191833.341372:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563
00000100:00100000:3.0:1776191833.341375:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096e89164 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630987200:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191833.341417:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2564
00000100:00100000:1.0:1776191833.341422:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005cfbecd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630987264:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191833.341492:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191833.341540:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096e89164 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630987200:12345-0@lo:8:kworker/u8:4.0 Request processed in 163us (2333us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191833.341546:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563
00000100:00100000:3.0:1776191833.341578:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000043c46f30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630987072:0@lo:400:kworker/u8:4.0
00000100:00080000:3.0:1776191833.341604:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191833.341620:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191833.341624:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a0c5ca5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630987200:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191833.341649:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000354fd625 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630986880:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191833.341658:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aaba3ebf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630987136:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191833.342539:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1767
00000100:00100000:2.0:1776191833.342547:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002986576f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630986688:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191833.342577:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191833.342629:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002986576f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630986688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (3918us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191833.342636:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1767
00000100:00100000:2.0:1776191833.342649:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1768
00000100:00100000:2.0:1776191833.342653:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b4ee822 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630987456:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191833.342662:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191833.342700:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b4ee822 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630987456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (3560us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191833.342705:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1768
00000100:00100000:2.0:1776191833.342755:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007a366bf6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630986688:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191833.342812:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d808a8bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630987456:0@lo:13:osp-pre-0-1.0
00010000:02020000:1.0:1776191833.343370:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191833.343742:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005cfbecd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467630987264:12345-0@lo:8:kworker/u8:4.0 Request processed in 2318us (4491us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191833.343751:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2564
00000100:00080000:3.0:1776191833.343910:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191833.343916:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191833.343921:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086a13048 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630987264:0@lo:8:kworker/u8:4.0
00010000:00010000:3.0:1776191834.106349:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191834.972139:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191834.972189:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191834.972218:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191834.972248:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191834.972271:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191834.972372:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613825216
00000100:00100000:1.0:1776191834.972376:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613825088
00000100:00100000:2.0:1776191834.972416:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613825152
00000100:00100000:1.0:1776191834.972421:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613825024
00000100:00100000:2.0:1776191834.972448:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2207
00000100:00100000:1.0:1776191834.972453:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5164
00000100:00100000:2.0:1776191834.972458:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016dc0009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613825152:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191834.972461:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e72cee95 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613825088:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191834.972561:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2565
00000100:00100000:3.0:1776191834.972566:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d808a8bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613825216:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:3.0:1776191834.972662:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191834.972713:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016dc0009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613825152:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 256us (442us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191834.972721:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2207
00000100:00100000:1.0:1776191834.973164:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e72cee95 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613825088:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 702us (944us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191834.973174:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5164
00000100:00100000:1.0:1776191834.973192:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5165
00000100:00100000:1.0:1776191834.973197:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f74cc947 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613825024:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191834.973224:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f74cc947 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613825024:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 27us (977us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191834.973230:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5165
00000100:00100000:3.0:1776191834.973289:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d808a8bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613825216:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 720us (1158us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191834.973299:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2565
00000100:00100000:0.0:1776191834.974937:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613824960
00000100:00100000:0.0:1776191834.975004:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1919
00000100:00100000:0.0:1776191834.975011:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000000cecea7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613824960:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191834.975114:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000000cecea7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613824960:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 102us (2925us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191834.975122:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1919
00010000:00010000:0.0:1776191835.130281:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191836.154303:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191836.410672:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630987520:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191836.410743:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191836.410913:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630987520
00000100:00100000:0.0:1776191836.410966:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3509
00000100:00100000:0.0:1776191836.410973:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009df06d88 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630987520:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191836.411006:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191836.411080:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009df06d88 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630987520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (337us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191836.411087:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3509
00000100:00100000:1.0:1776191836.411452:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630987520:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191837.178269:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191837.434342:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1776191837.434365:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053bdf8f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630987584:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191837.434442:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191837.434563:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630987584
00000100:00100000:3.0:1776191837.434609:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3510
00000100:00100000:3.0:1776191837.434614:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c049762 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630987584:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191837.434645:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191837.434692:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c049762 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630987584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (252us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191837.434699:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3510
00000100:00100000:2.0:1776191837.434780:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053bdf8f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630987584:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191838.203950:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1776191838.458483:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191838.458491:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191838.458494:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191838.458501:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4371
00000100:00080000:2.0:1776191838.458505:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191838.458511:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191838.458530:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000f210a7b3 x1862467630988096/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191838.458544:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191838.458546:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191838.458547:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191838.458550:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4371
00000100:00080000:2.0:1776191838.458552:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191838.458555:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191838.458566:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000005f28ffee x1862467630988160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191838.458610:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009eabfd74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630987712:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191838.458669:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f210a7b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630988096:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191838.458677:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191838.458741:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000746b7981 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630987648:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191838.458780:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630987840:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191838.461873:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191838.461916:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005f28ffee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630988160:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191838.461956:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191838.462048:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630988096
00000100:00100000:3.0:1776191838.462079:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630988160
00000100:00100000:3.0:1776191838.462113:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566
00000100:00100000:3.0:1776191838.462118:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c02746a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630988096:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191838.462225:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191838.462266:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c02746a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630988096:12345-0@lo:8:kworker/u8:2.0 Request processed in 147us (399us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191838.462272:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566
00000100:00100000:3.0:1776191838.462304:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567
00000100:00100000:3.0:1776191838.462308:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ec42a12f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630988160:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191838.462407:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191838.462431:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ec42a12f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630988160:12345-0@lo:8:kworker/u8:2.0 Request processed in 122us (475us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191838.462437:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567
00000100:00080000:3.0:1776191838.462473:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191838.462477:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191838.462481:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f210a7b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630988096:0@lo:8:kworker/u8:2.0
00000100:00080000:3.0:1776191838.462487:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191838.462489:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191838.462491:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005f28ffee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630988160:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191838.462534:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630987712
00000100:00100000:3.0:1776191838.462561:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5166
00000100:00100000:3.0:1776191838.462565:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a6aa2ef8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630987712:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191838.462601:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a6aa2ef8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630987712:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (3929us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191838.462607:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5166
00000100:00100000:3.0:1776191838.462633:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030eda894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630987776:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191838.462659:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191838.464500:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc840106 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630988032:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191838.464558:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191838.464575:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006062370f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630988416:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191838.464597:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191838.464621:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191838.464627:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000418a6d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630988352:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191838.464647:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191838.464698:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630988416
00000100:00100000:3.0:1776191838.464743:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630988352
00000100:00100000:3.0:1776191838.464764:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1769
00000100:00100000:3.0:1776191838.464771:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba9731d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630988416:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191838.464800:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191838.464835:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba9731d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630988416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (238us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191838.464842:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1769
00000100:00100000:3.0:1776191838.464856:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1770
00000100:00100000:3.0:1776191838.464859:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004a57869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630988352:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191838.464868:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191838.464888:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004a57869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630988352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 28us (241us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191838.464893:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1770
00000100:00100000:3.0:1776191838.464913:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630988032
00000100:00100000:3.0:1776191838.464933:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2208
00000100:00100000:3.0:1776191838.464937:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004da0b0e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630988032:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191838.464961:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004da0b0e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630988032:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (404us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191838.464967:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2208
00000100:00100000:3.0:1776191838.464983:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630987776
00000100:00100000:3.0:1776191838.465141:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3511
00000100:00100000:3.0:1776191838.465146:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f210a7b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630987776:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191838.465188:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f210a7b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630987776:12345-0@lo:400:kworker/u8:2.0 Request processed in 41us (2528us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191838.465193:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3511
00000100:00100000:3.0:1776191838.465232:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000418a6d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630988352:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191838.465246:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030eda894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630987776:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191838.465253:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc840106 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630988032:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191838.465263:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006062370f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630988416:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191838.472849:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191838.472941:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000205ceda0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630988224:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191838.472978:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191838.473184:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191838.473231:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630987648
00000100:00100000:2.0:1776191838.474959:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009eabfd74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630987712:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191838.474977:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000068cadb2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630987968:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191838.475030:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191838.475104:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630987968
00000100:00100000:2.0:1776191838.475138:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2209
00000100:00100000:2.0:1776191838.475144:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ce899cfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630987968:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191838.475185:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ce899cfc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630987968:12345-0@lo:400:kworker/u8:2.0 Request processed in 41us (156us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191838.475192:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2209
00000100:00100000:2.0:1776191838.475233:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000068cadb2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630987968:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191838.475428:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1920
00000100:00100000:1.0:1776191838.475440:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e23389f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630987648:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191838.475480:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e23389f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467630987648:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (2297us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191838.475487:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1920
00000100:00100000:1.0:1776191838.475517:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008831914d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630987904:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191838.475543:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191838.475566:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630987904
00000100:00100000:1.0:1776191838.475590:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3512
00000100:00100000:1.0:1776191838.475593:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000059e49ec2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630987904:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191838.475620:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000059e49ec2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630987904:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (77us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191838.475626:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3512
00000100:00100000:1.0:1776191838.475645:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000083bd5abd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630988288:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191838.476980:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191838.477007:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630987840
00000100:00100000:1.0:1776191838.477245:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630988224
00000100:00100000:1.0:1776191838.477299:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5167
00000100:00100000:1.0:1776191838.477303:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fc54ddfd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630988224:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191838.477360:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fc54ddfd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630988224:12345-0@lo:400:kworker/u8:2.0 Request processed in 55us (4381us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191838.477366:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5167
00000100:00100000:0.0:1776191838.477490:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000205ceda0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630988224:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191838.477652:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5168
00000100:00100000:3.0:1776191838.477657:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb143dd0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630987840:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191838.477716:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb143dd0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630987840:12345-0@lo:400:kworker/u8:2.0 Request processed in 58us (4874us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191838.477726:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5168
00000100:00100000:1.0:1776191838.479383:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630987840:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191838.483952:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000746b7981 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467630987648:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191838.483974:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008831914d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630987904:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191838.484256:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630988288
00000100:00100000:0.0:1776191838.484314:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5169
00000100:00100000:0.0:1776191838.484320:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1bce22f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630988288:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191838.484418:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1bce22f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630988288:12345-0@lo:400:kworker/u8:2.0 Request processed in 97us (7442us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191838.484425:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5169
00000100:00100000:2.0:1776191838.484985:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000083bd5abd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630988288:0@lo:400:kworker/u8:2.0
00010000:00010000:0.0:1776191839.226434:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191840.090759:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191840.090802:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191840.090852:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191840.090889:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191840.090980:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613825344
00000100:00100000:0.0:1776191840.091071:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613825408
00000100:00100000:0.0:1776191840.091095:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5170
00000100:00100000:0.0:1776191840.091102:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000083bd5abd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613825344:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191840.091178:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000083bd5abd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613825344:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 76us (426us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191840.091187:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5170
00000100:00100000:0.0:1776191840.091206:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5171
00000100:00100000:0.0:1776191840.091211:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000205ceda0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613825408:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191840.091234:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000205ceda0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613825408:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 23us (346us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191840.091239:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5171
00000100:00100000:0.0:1776191840.091348:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613825472
00000100:00100000:0.0:1776191840.091381:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2210
00000100:00100000:0.0:1776191840.091385:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000182c146b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613825472:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191840.091414:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000182c146b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613825472:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 28us (612us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191840.091419:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2210
00000100:00100000:1.0:1776191840.091761:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613825280
00000100:00100000:1.0:1776191840.091796:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1921
00000100:00100000:1.0:1776191840.091801:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4da44d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613825280:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191840.091838:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4da44d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613825280:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 37us (987us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191840.091844:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1921
00000100:00100000:0.0:1776191840.092428:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191840.093687:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613825536
00000100:00100000:2.0:1776191840.093793:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2568
00000100:00100000:2.0:1776191840.093800:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008611bf7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613825536:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:2.0:1776191840.093917:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191840.093992:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008611bf7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613825536:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 192us (1567us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191840.093999:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2568
00010000:00010000:3.0:1776191840.250645:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191841.274349:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191841.533587:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006062370f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630988480:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191841.533660:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191841.533780:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630988480
00000100:00100000:3.0:1776191841.533837:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3513
00000100:00100000:3.0:1776191841.533843:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000053bdf8f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630988480:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191841.533874:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191841.533922:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000053bdf8f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630988480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (263us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191841.533929:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3513
00000100:00100000:0.0:1776191841.534064:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006062370f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630988480:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191842.298267:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191842.554343:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191842.554363:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086a13048 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630988544:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191842.554430:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191842.554646:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630988544
00000100:00100000:3.0:1776191842.554724:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3514
00000100:00100000:3.0:1776191842.554730:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006062370f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630988544:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191842.554761:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191842.554810:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006062370f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630988544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (380us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191842.554817:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3514
00000100:00100000:0.0:1776191842.554883:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086a13048 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630988544:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191843.322239:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1776191843.578304:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191843.578312:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191843.578315:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191843.578322:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4376
00000100:00080000:2.0:1776191843.578325:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191843.578331:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191843.578351:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000009ce8cc66 x1862467630989056/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191843.578368:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191843.578371:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191843.578373:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191843.578375:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4376
00000100:00080000:2.0:1776191843.578377:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191843.578379:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191843.578389:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000f2e3253b x1862467630989120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191843.578430:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ce8cc66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630989056:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191843.578442:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005f28ffee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630988608:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191843.578511:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009eabfd74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630988736:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191843.578620:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000746b7981 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630988672:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191843.587079:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191843.587139:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630988608
00000100:00100000:0.0:1776191843.587193:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1922
00000100:00100000:0.0:1776191843.587198:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e54e7edc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630988608:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191843.587240:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e54e7edc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630988608:12345-0@lo:400:kworker/u8:2.0 Request processed in 42us (167us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191843.587250:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1922
00000100:00100000:0.0:1776191843.587615:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8ca4c1a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630988864:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191843.587651:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191843.587681:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630988864
00000100:00100000:0.0:1776191843.587710:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3515
00000100:00100000:0.0:1776191843.587714:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a366bf6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630988864:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191843.587750:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a366bf6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630988864:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (99us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191843.587755:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3515
00000100:00100000:0.0:1776191843.587773:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000067cb6dcd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630989248:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191843.587793:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191843.587822:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005f28ffee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630988608:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191843.587844:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8ca4c1a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630988864:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191843.587865:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776191843.587871:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630989312:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191843.587894:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191843.587941:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191843.587969:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004790ea41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630988992:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191843.587982:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630988736
00000100:00100000:0.0:1776191843.588000:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3516
00000100:00100000:0.0:1776191843.588003:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aaba3ebf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630988736:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191843.588029:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aaba3ebf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630988736:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (102us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191843.588051:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3516
00000100:00100000:0.0:1776191843.588077:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630989312
00000100:00100000:2.0:1776191843.588093:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191843.588100:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1771
00000100:00100000:0.0:1776191843.588104:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b8ca4c1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630989312:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191843.588122:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2e3253b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630989120:0@lo:8:kworker/u8:2.0
00002000:00000024:0.0:1776191843.588127:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191843.588156:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191843.588190:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630989056
00000100:00100000:2.0:1776191843.588211:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630989120
00000100:00100000:1.0:1776191843.588744:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191843.588785:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630988992
00000100:00100000:1.0:1776191843.588796:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005f28ffee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630989376:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191843.588818:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2211
00000100:00100000:2.0:1776191843.588826:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000097245d31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3365:x1862467630988992:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191843.588827:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191843.588859:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009eabfd74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630988736:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191843.588873:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004790ea41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630988992:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191843.588877:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000097245d31 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3365:x1862467630988992:12345-0@lo:400:kworker/u8:2.0 Request processed in 51us (131us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191843.588885:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2211
00000100:00100000:1.0:1776191843.588895:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:2.0:1776191843.588904:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2569
00000100:00100000:1.0:1776191843.588905:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f7c58b5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630988800:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191843.588920:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090a9e988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630989056:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191843.588945:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191843.588960:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d1ba4a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630989184:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191843.588991:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191843.589022:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630989376
00000100:00100000:1.0:1776191843.589066:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1772
00000100:00100000:1.0:1776191843.589070:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a0c5ca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630989376:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191843.589082:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191843.589111:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a0c5ca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630989376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (288us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191843.589117:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1772
00000100:00100000:1.0:1776191843.589136:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630989248
00000100:00100000:1.0:1776191843.589159:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630988800
00000100:00100000:1.0:1776191843.589176:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630989184
00000100:00100000:1.0:1776191843.589198:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5172
00000100:00100000:1.0:1776191843.589202:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ade5f5f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630989248:12345-0@lo:400:kworker/u8:2.0
00010000:02020000:2.0:1776191843.589431:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191843.589552:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090a9e988 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630989056:12345-0@lo:8:kworker/u8:2.0 Request processed in 633us (1461us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191843.589559:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2569
00000100:00100000:2.0:1776191843.589575:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2570
00000100:00100000:2.0:1776191843.589578:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000088385c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630989120:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191843.589656:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191843.589679:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000088385c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630989120:12345-0@lo:8:kworker/u8:2.0 Request processed in 100us (1525us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191843.589684:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2570
00000100:00100000:3.0:1776191843.589886:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191843.589919:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000cddb455 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630988928:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191843.589945:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191843.590143:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630988928
00000100:00100000:2.0:1776191843.590161:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2212
00000100:00100000:2.0:1776191843.590165:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb97b35c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630988928:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191843.593933:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b8ca4c1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630989312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5821us (6031us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191843.593948:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1771
00000100:00100000:0.0:1776191843.593992:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630988672
00000100:00100000:0.0:1776191843.594022:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5173
00000100:00100000:0.0:1776191843.594028:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000043c46f30 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630988800:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191843.594069:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ade5f5f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630989248:12345-0@lo:400:kworker/u8:2.0 Request processed in 4864us (6273us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191843.594080:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5172
00000100:00100000:1.0:1776191843.594100:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5174
00000100:00100000:1.0:1776191843.594105:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a426c55 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630989184:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191843.594125:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000043c46f30 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630988800:12345-0@lo:400:kworker/u8:2.0 Request processed in 95us (5180us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191843.594133:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5173
00000100:00100000:1.0:1776191843.594149:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a426c55 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630989184:12345-0@lo:400:kworker/u8:2.0 Request processed in 41us (5155us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191843.594154:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5175
00000100:00080000:3.0:1776191843.594264:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191843.594271:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191843.594275:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ce8cc66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630989056:0@lo:8:kworker/u8:2.0
00000100:00080000:3.0:1776191843.594474:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191843.594477:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191843.594480:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2e3253b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630989120:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191843.594660:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000250a4bd2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630988672:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191843.594706:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000250a4bd2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630988672:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (4820us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191843.595093:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5174
00000100:00100000:1.0:1776191843.595174:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630989312:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191843.595188:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000067cb6dcd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630989248:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191843.595222:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000746b7981 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630988672:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191843.596937:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5175
00000100:00100000:1.0:1776191843.597499:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f7c58b5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630988800:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191843.599895:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb97b35c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630988928:12345-0@lo:400:kworker/u8:2.0 Request processed in 9721us (9941us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191843.599920:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2212
00000100:00100000:1.0:1776191843.600078:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d1ba4a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630989184:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191843.600154:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000cddb455 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630988928:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191843.600224:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005f28ffee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630989376:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1776191844.347115:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191845.211159:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191845.211215:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191845.211324:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613825664
00000100:00100000:0.0:1776191845.211385:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5176
00000100:00100000:0.0:1776191845.211392:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000088385c06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613825664:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191845.211478:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000088385c06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613825664:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 84us (328us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191845.211486:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5176
00000100:00100000:2.0:1776191845.211660:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191845.211689:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191845.211732:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613825600
00000100:00100000:0.0:1776191845.211758:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1923
00000100:00100000:0.0:1776191845.211763:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f9ea876 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613825600:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191845.211798:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f9ea876 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613825600:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 34us (139us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191845.211804:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1923
00000100:00100000:2.0:1776191845.219080:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191845.219347:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613825728
00000100:00100000:3.0:1776191845.219414:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5177
00000100:00100000:3.0:1776191845.219421:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c719287 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613825728:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191845.219497:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c719287 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613825728:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 75us (425us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191845.219506:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5177
00000100:00100000:1.0:1776191845.222122:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613825792
00000100:00100000:1.0:1776191845.222224:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613825856
00000100:00100000:1.0:1776191845.222258:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2213
00000100:00100000:1.0:1776191845.222265:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1fe5010 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613825792:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191845.222342:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1fe5010 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613825792:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 76us (11136us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191845.222358:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2213
00000100:00100000:1.0:1776191845.222378:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2571
00000100:00100000:1.0:1776191845.222382:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000044860d59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613825856:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:1.0:1776191845.222479:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191845.222505:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000044860d59 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613825856:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 121us (10816us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191845.222511:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2571
00010000:00010000:0.0:1776191845.370298:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191846.394192:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191846.650484:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005f28ffee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630989440:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191846.650553:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191846.650687:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630989440
00000100:00100000:1.0:1776191846.650736:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3517
00000100:00100000:1.0:1776191846.650741:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004da0b0e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630989440:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191846.650771:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191846.652959:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004da0b0e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630989440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2210us (2400us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191846.652973:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3517
00000100:00100000:3.0:1776191846.653336:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005f28ffee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630989440:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191847.418416:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191847.674327:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1776191847.674345:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630989504:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191847.674417:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191847.674477:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630989504
00000100:00100000:1.0:1776191847.674527:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3518
00000100:00100000:1.0:1776191847.674534:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d335ff71 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630989504:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191847.674569:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191847.680244:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d335ff71 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630989504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5702us (5820us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191847.680260:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3518
00000100:00100000:2.0:1776191847.681427:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630989504:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191848.442890:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191848.698416:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008831914d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630989632:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191848.698491:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191848.698578:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc840106 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630989760:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191848.698608:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191848.698632:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:0.0:1776191848.698637:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630989568:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191848.698656:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191848.698668:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ce899cfc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630989824:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191848.698684:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191848.698710:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630989760
00000100:00100000:0.0:1776191848.698745:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3519
00000100:00100000:0.0:1776191848.698750:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000182c146b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630989760:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191848.698805:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000182c146b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630989760:12345-0@lo:400:kworker/u8:4.0 Request processed in 54us (197us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191848.698816:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3519
00000100:00100000:0.0:1776191848.698837:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630989568
00000100:00100000:0.0:1776191848.698855:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630989824
00000100:00100000:0.0:1776191848.698880:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1773
00000100:00100000:0.0:1776191848.698883:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005f28ffee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630989568:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191848.698903:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191848.699126:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005f28ffee pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630989568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 241us (468us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191848.699133:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1773
00000100:00100000:0.0:1776191848.699144:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1774
00000100:00100000:0.0:1776191848.699148:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003e15780a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630989824:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191848.699157:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191848.699188:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003e15780a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630989824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (504us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191848.699194:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1774
00000100:00100000:0.0:1776191848.699265:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a6d843e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630989568:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191848.699279:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ce899cfc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630989824:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191848.699288:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc840106 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630989760:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191848.699340:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000068cadb2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630989696:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191848.699366:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191848.699408:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630989696
00000100:00100000:0.0:1776191848.699431:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5178
00000100:00100000:0.0:1776191848.699434:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d64d2e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630989696:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191848.699465:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d64d2e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630989696:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (99us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191848.699470:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5178
00000100:00100000:0.0:1776191848.699492:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000068cadb2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630989696:0@lo:400:kworker/u8:4.0
00000100:00080000:3.0:1776191848.700894:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1776191848.700966:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc840106 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630989952:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191848.701012:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1776191848.701064:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191848.701067:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191848.701073:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4381
00000100:00080000:3.0:1776191848.701075:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191848.701080:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191848.701102:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000128cb0b2 x1862467630990016/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191848.701127:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776191848.701134:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000068cadb2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630989888:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191848.701158:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191848.701203:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630989888
00000100:00100000:1.0:1776191848.701235:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5179
00000100:00100000:1.0:1776191848.701240:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a6d843e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630989888:12345-0@lo:400:kworker/u8:4.0
00000100:00080000:3.0:1776191848.701279:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1776191848.701281:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a6d843e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630989888:12345-0@lo:400:kworker/u8:4.0 Request processed in 39us (121us total) trans 0 rc 0/0
00000100:00080000:3.0:1776191848.701286:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191848.701289:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1776191848.701292:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5179
00000100:00080000:3.0:1776191848.701296:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4381
00000100:00080000:3.0:1776191848.701299:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191848.701304:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191848.701336:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000068cadb2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630989888:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191848.701337:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630989632
00000100:00100000:1.0:1776191848.701372:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630990016:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191848.701374:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1924
00000100:00100000:2.0:1776191848.701382:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000653a1d11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630989632:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191848.701401:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191848.701434:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000653a1d11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630989632:12345-0@lo:400:kworker/u8:4.0 Request processed in 50us (2943us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191848.701441:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1924
00000100:00100000:2.0:1776191848.701479:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008831914d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630989632:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191848.701511:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630990016
00000100:00100000:2.0:1776191848.701543:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572
00000100:00100000:2.0:1776191848.701547:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000068cadb2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630990016:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191848.701636:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630989952
00000100:00100000:0.0:1776191848.701659:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3520
00000100:00100000:0.0:1776191848.701663:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000086a13048 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630989952:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191848.701695:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000086a13048 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630989952:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (683us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191848.701700:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3520
00000100:00100000:3.0:1776191848.701759:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000030eda894 x1862467630990080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191848.701885:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030eda894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630990080:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191848.702091:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191848.702159:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630990080
00000100:00100000:1.0:1776191848.702196:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2573
00000100:00100000:1.0:1776191848.702200:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006503fab3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630990080:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191848.702282:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:02020000:2.0:1776191848.702317:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191848.702545:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630990208:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191848.702577:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191848.702971:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006503fab3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467630990080:12345-0@lo:8:kworker/u8:4.0 Request processed in 768us (879us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191848.702980:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2573
00000100:00100000:1.0:1776191848.703020:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc840106 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630989952:0@lo:400:kworker/u8:4.0
00000100:00080000:0.0:1776191848.703054:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191848.703059:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191848.703063:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030eda894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630990080:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191848.703166:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191848.703184:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009c02746a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630990144:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191848.703257:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630990208
00000100:00100000:1.0:1776191848.703289:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5180
00000100:00100000:1.0:1776191848.703294:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000418a6d34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630990208:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191848.703331:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000418a6d34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630990208:12345-0@lo:400:kworker/u8:4.0 Request processed in 37us (755us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191848.703406:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5180
00000100:00100000:3.0:1776191848.703648:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191848.703686:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630990208:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191848.703739:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630990144
00000100:00100000:1.0:1776191848.703911:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5181
00000100:00100000:1.0:1776191848.703916:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004feb6fa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630990144:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191848.703950:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004feb6fa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630990144:12345-0@lo:400:kworker/u8:4.0 Request processed in 34us (303us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191848.703955:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5181
00000100:00100000:2.0:1776191848.704483:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000068cadb2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630990016:12345-0@lo:8:kworker/u8:4.0 Request processed in 2933us (3082us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191848.704492:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572
00000100:00080000:0.0:1776191848.704525:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191848.704529:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191848.704533:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630990016:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191848.704534:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009c02746a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630990144:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191849.466285:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191850.331766:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191850.331817:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191850.331864:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613825984
00000100:00100000:2.0:1776191850.331870:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191850.331911:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191850.331935:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191850.331963:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613826112
00000100:00100000:2.0:1776191850.331994:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613826176
00000100:00100000:1.0:1776191850.332007:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613826048
00000100:00100000:2.0:1776191850.332029:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2214
00000100:00100000:1.0:1776191850.332078:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5182
00000100:00100000:2.0:1776191850.332090:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048707662 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613826112:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191850.332091:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000084541faf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613825984:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191850.332197:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5183
00000100:00100000:3.0:1776191850.332205:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000085d4558 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613826048:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191850.332208:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613825920
00000100:00100000:0.0:1776191850.332248:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1925
00000100:00100000:0.0:1776191850.332253:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd6c2b01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613825920:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191850.335377:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000084541faf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613825984:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 3282us (3613us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191850.335394:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5182
00000100:00100000:1.0:1776191850.335451:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2574
00000100:00100000:1.0:1776191850.335458:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f9388e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613826176:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:1.0:1776191850.335555:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191850.336793:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f9388e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613826176:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 1330us (4853us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191850.336806:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2574
00000100:00100000:2.0:1776191850.337388:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048707662 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613826112:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 5299us (5568us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191850.337400:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2214
00000100:00100000:3.0:1776191850.340291:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000085d4558 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613826048:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 8077us (8371us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191850.340307:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5183
00000100:00100000:0.0:1776191850.340443:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd6c2b01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613825920:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 8187us (8572us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191850.340453:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1925
00010000:00010000:0.0:1776191850.494398:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191851.514801:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191851.770639:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004f4270fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630990272:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191851.770707:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191851.771389:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630990272
00000100:00100000:0.0:1776191851.771446:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3521
00000100:00100000:0.0:1776191851.771453:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a5a67c63 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630990272:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191851.771488:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191851.771640:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a5a67c63 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630990272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 186us (933us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191851.771647:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3521
00000100:00100000:3.0:1776191851.772241:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004f4270fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630990272:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191852.538236:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191852.794565:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1776191852.795601:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000746b7981 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630990336:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191852.795668:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191852.795838:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630990336
00000100:00100000:0.0:1776191852.796142:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3522
00000100:00100000:0.0:1776191852.796148:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d3569406 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630990336:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191852.796181:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191852.796232:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d3569406 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630990336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (564us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191852.796239:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3522
00000100:00100000:3.0:1776191852.796305:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000746b7981 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630990336:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191853.563188:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191853.818612:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1776191853.818633:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000a2092dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630990400:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191853.818695:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1776191853.819089:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191853.819093:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191853.819096:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191853.819101:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4386
00000100:00080000:2.0:1776191853.819104:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191853.819109:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191853.819127:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000003a98c80a x1862467630990848/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191853.819143:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191853.819146:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191853.819147:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191853.819150:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4386
00000100:00080000:2.0:1776191853.819151:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191853.819154:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191853.819164:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000a1da7374 x1862467630990912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191853.819193:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d1c8a441 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630990592:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191853.819222:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191853.819239:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cd9107bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630990976:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191853.819259:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191853.819273:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:2.0:1776191853.819277:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000746b7981 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630990528:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191853.819296:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191853.819307:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000085e6ba1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630990784:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191853.819340:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191853.819365:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a98c80a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630990848:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191853.819386:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191853.819397:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1da7374 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630990912:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191853.819416:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191853.819455:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630990592
00000100:00100000:2.0:1776191853.819491:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3523
00000100:00100000:2.0:1776191853.819496:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b048c733 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630990592:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191853.819537:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b048c733 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630990592:12345-0@lo:400:kworker/u8:2.0 Request processed in 41us (315us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191853.819544:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3523
00000100:00100000:2.0:1776191853.819581:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d1c8a441 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630990592:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191853.819603:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630990784
00000100:00100000:2.0:1776191853.819623:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630990848
00000100:00100000:2.0:1776191853.819632:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630990912
00000100:00100000:2.0:1776191853.819642:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2215
00000100:00100000:2.0:1776191853.819646:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004a22f9ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630990784:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191853.819673:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004a22f9ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630990784:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (334us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191853.819679:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2215
00000100:00100000:2.0:1776191853.819696:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000085e6ba1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630990784:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191853.819710:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2575
00000100:00100000:2.0:1776191853.819713:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b2bebc0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630990848:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191853.819821:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191853.819852:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b2bebc0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630990848:12345-0@lo:8:kworker/u8:2.0 Request processed in 138us (466us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191853.819857:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2575
00000100:00080000:2.0:1776191853.819876:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191853.819879:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191853.819882:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a98c80a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630990848:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191853.819897:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2576
00000100:00100000:2.0:1776191853.819901:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a96a54e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630990912:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191853.819984:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191853.820007:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a96a54e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630990912:12345-0@lo:8:kworker/u8:2.0 Request processed in 105us (591us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191853.820012:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2576
00000100:00080000:2.0:1776191853.820027:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191853.820030:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191853.820067:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1da7374 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630990912:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191853.820589:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b847a9ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630990656:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191853.820625:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191853.820650:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000025f3deb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630991040:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191853.820669:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191853.820684:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:3.0:1776191853.820688:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000029e81afd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630990464:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191853.820709:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191853.820722:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027e578e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630990720:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191853.820739:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191853.820779:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630990976
00000100:00100000:3.0:1776191853.820818:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630990528
00000100:00100000:3.0:1776191853.820831:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630990656
00000100:00100000:3.0:1776191853.820841:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630991040
00000100:00100000:3.0:1776191853.820855:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5184
00000100:00100000:3.0:1776191853.820859:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e00c592 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630990976:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191853.820897:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e00c592 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630990976:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (1637us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191853.820903:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5184
00000100:00100000:3.0:1776191853.820913:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5185
00000100:00100000:3.0:1776191853.820916:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000348ababd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630990528:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191853.820936:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000348ababd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630990528:12345-0@lo:400:kworker/u8:2.0 Request processed in 20us (1641us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191853.820941:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5185
00000100:00100000:3.0:1776191853.820948:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5186
00000100:00100000:3.0:1776191853.820951:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de02bb16 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630990656:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191853.820971:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de02bb16 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630990656:12345-0@lo:400:kworker/u8:2.0 Request processed in 19us (346us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191853.820975:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5186
00000100:00100000:3.0:1776191853.820982:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5187
00000100:00100000:3.0:1776191853.820985:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004faaa807 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630991040:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191853.821002:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004faaa807 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630991040:12345-0@lo:400:kworker/u8:2.0 Request processed in 17us (334us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191853.821007:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5187
00000100:00100000:3.0:1776191853.821066:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630990464
00000100:00100000:3.0:1776191853.821087:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1926
00000100:00100000:3.0:1776191853.821090:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000040bbf344 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630990464:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191853.821118:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000040bbf344 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630990464:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (408us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191853.821123:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1926
00000100:00100000:3.0:1776191853.821163:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630990720
00000100:00100000:3.0:1776191853.821185:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3524
00000100:00100000:3.0:1776191853.821189:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ec7cac8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630990720:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191853.821214:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ec7cac8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630990720:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (475us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191853.821219:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3524
00000100:00100000:3.0:1776191853.821241:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000029e81afd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630990464:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191853.821250:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027e578e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630990720:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191853.821258:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b847a9ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630990656:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191853.821264:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000025f3deb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630991040:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191853.821295:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000746b7981 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630990528:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191853.821304:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cd9107bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630990976:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191853.822665:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191853.822677:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bc840106 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630991104:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191853.822723:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191853.823079:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630990400
00000100:00100000:0.0:1776191853.823123:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630991104
00000100:00100000:0.0:1776191853.823147:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1775
00000100:00100000:0.0:1776191853.823152:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d2e07ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630990400:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191853.823181:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191853.823230:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d2e07ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630990400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (4535us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191853.823236:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1775
00000100:00100000:0.0:1776191853.823252:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1776
00000100:00100000:0.0:1776191853.823255:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008831914d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630991104:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191853.823266:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191853.823294:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008831914d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630991104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (572us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191853.823300:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1776
00000100:00100000:0.0:1776191853.823352:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bc840106 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630991104:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191853.823977:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000a2092dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630990400:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1776191854.587953:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191855.450940:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191855.450983:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191855.451013:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191855.451105:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191855.451142:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613826304
00000100:00100000:1.0:1776191855.451201:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613826368
00000100:00100000:1.0:1776191855.451225:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5188
00000100:00100000:1.0:1776191855.451232:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc840106 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613826304:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191855.451304:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc840106 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613826304:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 72us (321us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191855.451312:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5188
00000100:00100000:1.0:1776191855.451329:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5189
00000100:00100000:1.0:1776191855.451333:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f7c58b5d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613826368:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191855.451358:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f7c58b5d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613826368:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 24us (345us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191855.451364:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5189
00000100:00100000:1.0:1776191855.451396:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613826432
00000100:00100000:1.0:1776191855.451425:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2216
00000100:00100000:1.0:1776191855.451430:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d1ba4a82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613826432:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191855.451457:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d1ba4a82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613826432:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 27us (353us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191855.451463:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2216
00000100:00100000:1.0:1776191855.451977:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191855.452551:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613826240
00000100:00100000:2.0:1776191855.452595:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1927
00000100:00100000:2.0:1776191855.452601:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bbf84eea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613826240:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191855.452662:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bbf84eea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613826240:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 60us (1730us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191855.452670:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1927
00000100:00100000:3.0:1776191855.456970:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613826496
00000100:00100000:3.0:1776191855.457106:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2577
00000100:00100000:3.0:1776191855.457113:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000cddb455 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613826496:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:3.0:1776191855.457215:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191855.457298:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000cddb455 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613826496:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 184us (5322us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191855.457306:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2577
00010000:00010000:3.0:1776191855.611280:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191856.634338:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191856.890398:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776191856.890415:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a30924b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630991168:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191856.890483:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191856.890740:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630991168
00000100:00100000:0.0:1776191856.890791:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3525
00000100:00100000:0.0:1776191856.890796:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000067cb6dcd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630991168:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191856.890828:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191856.890877:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000067cb6dcd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630991168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (393us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191856.890883:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3525
00000100:00100000:0.0:1776191856.890924:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a30924b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630991168:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191857.660532:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191857.919066:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cd9107bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630991232:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191857.919139:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191857.919241:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630991232
00000100:00100000:3.0:1776191857.919296:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3526
00000100:00100000:3.0:1776191857.919302:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f2e3253b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630991232:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191857.919348:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191857.919555:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f2e3253b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630991232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 251us (416us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191857.919564:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3526
00000100:00100000:2.0:1776191857.919765:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cd9107bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630991232:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191858.683176:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191858.939001:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f598cfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630991296:0@lo:400:kworker/u8:4.0
00000100:00080000:3.0:1776191858.939017:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191858.939021:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191858.939024:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191858.939028:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4391
00000100:00080000:3.0:1776191858.939030:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191858.939049:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191858.939067:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000819bd127 x1862467630991744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191858.939081:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1776191858.939084:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1776191858.939084:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191858.939085:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191858.939088:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4391
00000100:00080000:3.0:1776191858.939090:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191858.939092:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191858.939108:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000b847a9ef x1862467630991808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191858.939114:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000421d4a36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630991552:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191858.939137:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191858.939139:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb4cf93d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630991360:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191858.939154:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000746b7981 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630991936:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191858.939175:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191858.939180:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a25bb0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630991488:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191858.939200:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000819bd127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630991744:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191858.939207:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191858.939220:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027e578e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630991872:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191858.939222:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191858.939236:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b847a9ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630991808:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191858.939238:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191858.939251:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:2.0:1776191858.939253:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191858.939255:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006821defb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630991424:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191858.939273:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191858.939282:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630991296
00000100:00100000:3.0:1776191858.939284:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd341e03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630991680:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191858.939301:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191858.939321:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1928
00000100:00100000:2.0:1776191858.939326:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000351c4067 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630991296:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191858.939339:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630991936
00000100:00100000:3.0:1776191858.939362:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630991488
00000100:00100000:2.0:1776191858.939366:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000351c4067 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630991296:12345-0@lo:400:kworker/u8:4.0 Request processed in 40us (284us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191858.939373:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1928
00000100:00100000:3.0:1776191858.939376:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630991872
00000100:00100000:3.0:1776191858.939390:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5190
00000100:00100000:3.0:1776191858.939393:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000025f3deb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630991936:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191858.939401:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630991744
00000100:00100000:2.0:1776191858.939416:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630991808
00000100:00100000:2.0:1776191858.939428:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630991680
00000100:00100000:2.0:1776191858.939447:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2217
00000100:00100000:2.0:1776191858.939450:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000023d9198f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630991680:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191858.939482:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000023d9198f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630991680:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (180us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191858.939488:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2217
00000100:00100000:2.0:1776191858.939498:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578
00000100:00100000:2.0:1776191858.939501:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a1da7374 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630991744:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191858.939591:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191858.939622:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a1da7374 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630991744:12345-0@lo:8:kworker/u8:4.0 Request processed in 119us (399us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191858.939627:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578
00000100:00100000:2.0:1776191858.939637:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579
00000100:00100000:2.0:1776191858.939640:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a98c80a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630991808:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191858.939664:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000025f3deb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630991936:12345-0@lo:400:kworker/u8:4.0 Request processed in 269us (488us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191858.939670:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5190
00000100:00100000:3.0:1776191858.939684:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5191
00000100:00100000:3.0:1776191858.939687:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029e81afd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630991488:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191858.939722:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029e81afd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630991488:12345-0@lo:400:kworker/u8:4.0 Request processed in 34us (515us total) trans 0 rc 0/0
00010000:02020000:2.0:1776191858.939723:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191858.939728:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5191
00000100:00100000:3.0:1776191858.939739:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5192
00000100:00100000:2.0:1776191858.939742:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a98c80a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630991808:12345-0@lo:8:kworker/u8:4.0 Request processed in 101us (489us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191858.939742:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c02746a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630991872:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191858.939747:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579
00000100:00100000:3.0:1776191858.939764:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c02746a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467630991872:12345-0@lo:400:kworker/u8:4.0 Request processed in 21us (525us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191858.939769:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5192
00000100:00100000:3.0:1776191858.939782:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630991552
00000100:00080000:2.0:1776191858.939788:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191858.939791:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191858.939794:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000819bd127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630991744:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191858.939795:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630991424
00000100:00080000:2.0:1776191858.939803:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1776191858.939804:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3527
00000100:00080000:2.0:1776191858.939805:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191858.939808:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b847a9ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630991808:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191858.939808:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd9107bd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630991552:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191858.939834:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd9107bd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630991552:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (697us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191858.939840:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3527
00000100:00100000:2.0:1776191858.939848:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd341e03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630991680:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191858.939850:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3528
00000100:00100000:3.0:1776191858.939853:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ec42a12f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630991424:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191858.939858:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a25bb0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630991488:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191858.939865:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027e578e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467630991872:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191858.939874:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ec42a12f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630991424:12345-0@lo:400:kworker/u8:4.0 Request processed in 20us (601us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191858.939879:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3528
00000100:00100000:2.0:1776191858.939883:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006821defb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630991424:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191858.939900:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000746b7981 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630991936:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191858.939909:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000421d4a36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630991552:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191858.939912:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191858.939915:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f598cfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630991296:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191858.939926:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005f9ce4ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630991616:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191858.939940:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630991360
00000100:00100000:3.0:1776191858.939945:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191858.939970:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5193
00000100:00100000:2.0:1776191858.939973:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e8472586 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630991360:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191858.939979:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630991616
00000100:00100000:3.0:1776191858.939998:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2218
00000100:00100000:3.0:1776191858.940001:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a5f06cb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630991616:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191858.940003:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e8472586 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630991360:12345-0@lo:400:kworker/u8:4.0 Request processed in 29us (102us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191858.940008:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5193
00000100:00100000:3.0:1776191858.940026:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a5f06cb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630991616:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (80us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191858.940051:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2218
00000100:00100000:2.0:1776191858.940063:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb4cf93d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630991360:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191858.940072:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005f9ce4ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630991616:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191858.940406:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776191858.940416:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a30924b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630992000:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191858.940457:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191858.940722:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1776191858.940730:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000085e6ba1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630992064:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191858.940754:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191858.940780:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630992000
00000100:00100000:2.0:1776191858.940803:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630992064
00000100:00100000:2.0:1776191858.940816:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1777
00000100:00100000:2.0:1776191858.940820:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000296e59aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630992000:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191858.940842:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191858.940874:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000296e59aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630992000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (418us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191858.940880:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1777
00000100:00100000:2.0:1776191858.940891:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1778
00000100:00100000:2.0:1776191858.940895:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000746b7981 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630992064:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191858.940913:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191858.940939:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000746b7981 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630992064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (185us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191858.940944:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1778
00000100:00100000:2.0:1776191858.940981:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000085e6ba1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630992064:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191858.941226:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a30924b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630992000:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1776191859.706229:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191860.570976:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191860.572896:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191860.572937:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191860.572976:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191860.572989:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613826688
00000100:00100000:0.0:1776191860.573058:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613826624
00000100:00100000:1.0:1776191860.573059:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191860.573081:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5194
00000100:00100000:0.0:1776191860.573088:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ce8cc66 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613826688:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191860.573108:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613826752
00000100:00100000:0.0:1776191860.573157:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ce8cc66 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613826688:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 69us (267us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191860.573165:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5194
00000100:00100000:0.0:1776191860.573182:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5195
00000100:00100000:0.0:1776191860.573186:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004790ea41 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613826624:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191860.573210:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004790ea41 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613826624:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 23us (274us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191860.573216:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5195
00000100:00100000:0.0:1776191860.573331:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613826816
00000100:00100000:0.0:1776191860.573350:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2580
00000100:00100000:0.0:1776191860.573353:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ebbe68e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613826816:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00000100:00100000:1.0:1776191860.573409:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2219
00000100:00100000:1.0:1776191860.573413:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009eabfd74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613826752:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191860.573445:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009eabfd74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613826752:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 31us (469us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191860.573451:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2219
00010000:02020000:0.0:1776191860.573462:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191860.573493:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ebbe68e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613826816:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 138us (434us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191860.573503:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2580
00000100:00100000:2.0:1776191860.575577:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613826560
00000100:00100000:2.0:1776191860.575629:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1929
00000100:00100000:2.0:1776191860.575636:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048ed839b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613826560:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191860.583138:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048ed839b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613826560:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 7494us (12162us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191860.583158:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1929
00010000:00010000:0.0:1776191860.730213:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191861.754250:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191862.010248:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a30924b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630992128:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191862.010326:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191862.010441:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630992128
00000100:00100000:3.0:1776191862.010490:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3529
00000100:00100000:3.0:1776191862.010495:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000085e6ba1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630992128:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191862.010526:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191862.010576:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000085e6ba1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630992128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (252us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191862.010583:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3529
00000100:00100000:2.0:1776191862.010659:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a30924b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630992128:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191862.778236:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191863.034353:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191863.034369:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027e578e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630992192:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191863.034432:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191863.034743:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630992192
00000100:00100000:1.0:1776191863.034799:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3530
00000100:00100000:1.0:1776191863.034806:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c3a79bd4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630992192:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191863.034840:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191863.034905:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c3a79bd4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630992192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (473us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191863.034912:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3530
00000100:00100000:2.0:1776191863.035133:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027e578e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630992192:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191863.802467:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191864.058193:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776191864.058217:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b5928219 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630992448:0@lo:400:kworker/u8:4.0
00000100:00080000:3.0:1776191864.058226:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191864.058232:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191864.058236:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191864.058241:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4397
00000100:00080000:3.0:1776191864.058244:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191864.058249:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191864.058270:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000994ca5e2 x1862467630992768/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191864.058286:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1776191864.058287:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191864.058292:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191864.058293:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191864.058296:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4397
00000100:00080000:3.0:1776191864.058298:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191864.058301:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191864.058312:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000481c290f x1862467630992832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191864.058332:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000852fcdad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630992320:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191864.058346:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000994ca5e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630992768:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191864.058365:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191864.058385:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191864.058393:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e600ea8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630992704:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191864.058408:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000481c290f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630992832:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191864.058423:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191864.058451:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630992448
00000100:00100000:0.0:1776191864.058454:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:0.0:1776191864.058461:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cfc3317d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630992512:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191864.058487:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191864.058490:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3531
00000100:00100000:3.0:1776191864.058497:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d75056b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630992448:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191864.058505:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003824609a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630992896:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191864.058527:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191864.058555:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d75056b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630992448:12345-0@lo:400:kworker/u8:4.0 Request processed in 57us (268us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191864.058575:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b5928219 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630992448:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191864.058686:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630992768
00000100:00100000:2.0:1776191864.058708:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630992704
00000100:00100000:0.0:1776191864.063153:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e56aacf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630992384:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191864.063246:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191864.063293:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000caebeb11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630992640:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191864.063318:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191864.063350:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027e578e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630993024:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191864.063372:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191864.063431:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630992512
00000100:00100000:0.0:1776191864.063477:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630992896
00000100:00100000:0.0:1776191864.063494:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630992384
00000100:00100000:0.0:1776191864.063512:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5196
00000100:00100000:0.0:1776191864.063517:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a30924b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630992512:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191864.063571:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a30924b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630992512:12345-0@lo:400:kworker/u8:4.0 Request processed in 53us (5084us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191864.063578:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5196
00000100:00100000:0.0:1776191864.063597:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5197
00000100:00100000:0.0:1776191864.063600:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000a2092dc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630992896:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191864.063626:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000a2092dc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630992896:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (5099us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191864.063632:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5197
00000100:00100000:0.0:1776191864.063656:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5198
00000100:00100000:0.0:1776191864.063660:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f4270fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630992384:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191864.063689:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f4270fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630992384:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (443us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191864.063695:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5198
00000100:00100000:2.0:1776191864.065003:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2220
00000100:00100000:2.0:1776191864.065018:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000040075bf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630992704:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191864.065105:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000040075bf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630992704:12345-0@lo:400:kworker/u8:4.0 Request processed in 90us (6682us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191864.065113:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2220
00000100:00100000:2.0:1776191864.065142:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630992640
00000100:00100000:2.0:1776191864.065176:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2221
00000100:00100000:2.0:1776191864.065180:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b5928219 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630992640:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191864.065199:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008ff2a89a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630992256:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191864.065226:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630993024
00000100:00100000:2.0:1776191864.065405:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b5928219 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630992640:12345-0@lo:400:kworker/u8:4.0 Request processed in 224us (2087us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191864.065411:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2221
00000100:00100000:2.0:1776191864.065424:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2581
00000100:00100000:2.0:1776191864.065428:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000b9cbeaa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630992768:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191864.065985:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191864.066031:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000b9cbeaa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630992768:12345-0@lo:8:kworker/u8:4.0 Request processed in 602us (7648us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191864.066071:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2581
00000100:00100000:2.0:1776191864.066596:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1776191864.066655:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191864.066660:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191864.066666:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000994ca5e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630992768:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191864.066697:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630992832
00000100:00100000:2.0:1776191864.066722:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582
00000100:00100000:3.0:1776191864.066727:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3531
00000100:00100000:2.0:1776191864.066730:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b847a9ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630992832:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191864.066819:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:02020000:2.0:1776191864.066828:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191864.066874:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b847a9ef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630992832:12345-0@lo:8:kworker/u8:4.0 Request processed in 145us (280us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191864.066881:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582
00000100:00080000:2.0:1776191864.066903:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191864.066906:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191864.066909:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000481c290f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630992832:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191864.072028:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630992320
00000100:00100000:2.0:1776191864.072571:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1930
00000100:00100000:2.0:1776191864.072580:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000062c92fc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630992320:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191864.072727:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630992256
00000100:00100000:1.0:1776191864.072758:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1779
00000100:00100000:1.0:1776191864.072763:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000128cb0b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630993024:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191864.072788:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191864.072866:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1780
00000100:00100000:0.0:1776191864.072871:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008bacde2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630992256:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191864.072884:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191864.075512:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000062c92fc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630992320:12345-0@lo:400:kworker/u8:4.0 Request processed in 2922us (17137us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191864.075529:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1930
00000100:00100000:3.0:1776191864.076132:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ecc8f95b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630992576:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191864.076295:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e56aacf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630992384:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191864.076324:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000caebeb11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630992640:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191864.083005:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000128cb0b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630993024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10231us (19623us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191864.083022:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1779
00000100:00100000:2.0:1776191864.083132:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027e578e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630993024:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191864.083139:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cfc3317d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630992512:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191864.083156:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003824609a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630992896:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191864.083165:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e600ea8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630992704:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191864.083176:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000852fcdad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630992320:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191864.083364:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008bacde2f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630992256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10491us (16545us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191864.083372:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1780
00000100:00100000:3.0:1776191864.083444:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191864.083475:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008eb36e2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630992960:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191864.083517:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191864.083521:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630992576
00000100:00100000:3.0:1776191864.083637:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008ff2a89a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630992256:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191864.083773:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3532
00000100:00100000:1.0:1776191864.083779:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d72c3363 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630992576:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191864.083848:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d72c3363 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630992576:12345-0@lo:400:kworker/u8:4.0 Request processed in 69us (407us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191864.083854:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3532
00000100:00100000:3.0:1776191864.083918:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ecc8f95b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630992576:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191864.084595:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630992960
00000100:00100000:0.0:1776191864.085264:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5199
00000100:00100000:0.0:1776191864.085272:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d6387b57 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630992960:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191864.085441:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d6387b57 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630992960:12345-0@lo:400:kworker/u8:4.0 Request processed in 169us (1924us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191864.085448:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5199
00000100:00100000:2.0:1776191864.085525:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008eb36e2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630992960:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191864.826812:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191865.690857:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191865.690901:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191865.690934:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191865.690969:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191865.691005:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191865.691082:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613827072
00000100:00100000:0.0:1776191865.691137:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613827136
00000100:00100000:0.0:1776191865.691154:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2222
00000100:00100000:0.0:1776191865.691160:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d0c84519 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613827072:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191865.691228:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d0c84519 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613827072:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 66us (259us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191865.691235:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2222
00000100:00100000:0.0:1776191865.691251:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2583
00000100:00100000:0.0:1776191865.691254:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009916a1d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613827136:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:0.0:1776191865.691358:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191865.691384:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009916a1d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613827136:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 129us (389us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191865.691391:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2583
00000100:00100000:2.0:1776191865.691741:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613826880
00000100:00100000:2.0:1776191865.691776:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1931
00000100:00100000:2.0:1776191865.691780:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c45da90d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613826880:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191865.691820:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c45da90d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613826880:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 39us (972us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191865.691827:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1931
00000100:00100000:2.0:1776191865.691896:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613826944
00000100:00100000:2.0:1776191865.691920:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613827008
00000100:00100000:2.0:1776191865.691946:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5200
00000100:00100000:2.0:1776191865.691950:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030eda894 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613826944:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191865.691980:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030eda894 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613826944:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 29us (1079us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191865.691986:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5200
00000100:00100000:2.0:1776191865.691999:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5201
00000100:00100000:2.0:1776191865.692002:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ce899cfc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613827008:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191865.692025:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ce899cfc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613827008:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 22us (1091us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191865.692057:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5201
00010000:00010000:0.0:1776191865.852450:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191866.880167:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191867.130478:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea373370 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630993088:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191867.130559:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191867.136503:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630993088
00000100:00100000:3.0:1776191867.136692:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3533
00000100:00100000:3.0:1776191867.136699:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000354fd625 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630993088:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191867.136738:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191867.136840:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000354fd625 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630993088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (6282us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191867.136847:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3533
00000100:00100000:1.0:1776191867.137052:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea373370 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630993088:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191867.898430:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191868.163180:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008eb36e2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630993152:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191868.163268:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191868.163368:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630993152
00000100:00100000:3.0:1776191868.163427:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3534
00000100:00100000:3.0:1776191868.163433:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027e578e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630993152:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191868.163479:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191868.163530:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027e578e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630993152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (263us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191868.163536:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3534
00000100:00100000:2.0:1776191868.163736:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008eb36e2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630993152:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191868.922764:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191869.178355:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191869.178377:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e600ea8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630993216:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191869.178445:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191869.178637:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630993216
00000100:00100000:1.0:1776191869.178690:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1781
00000100:00100000:1.0:1776191869.178697:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ea373370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630993216:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191869.178747:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191869.178805:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ea373370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630993216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (361us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191869.178812:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1781
00000100:00080000:2.0:1776191869.180070:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191869.180077:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191869.180080:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191869.180086:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4402
00000100:00080000:2.0:1776191869.180089:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191869.180095:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191869.180113:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000994ca5e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630993472:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191869.180114:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000001f598cfd x1862467630993664/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191869.180133:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191869.180136:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191869.180138:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191869.180141:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4402
00000100:00080000:2.0:1776191869.180143:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:2.0:1776191869.180146:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191869.180158:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000421d4a36 x1862467630993728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191869.180167:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191869.180198:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f598cfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630993664:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191869.180204:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a25bb0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630993856:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191869.180232:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191869.180240:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191869.180253:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000421d4a36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630993728:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191869.180269:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:1.0:1776191869.180278:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000caebeb11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630993280:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191869.180279:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191869.180312:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630993664
00000100:00100000:1.0:1776191869.180317:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191869.180337:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005f9ce4ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630993536:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191869.180342:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630993728
00000100:00100000:2.0:1776191869.180368:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2584
00000100:00100000:1.0:1776191869.180369:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191869.180376:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd341e03 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630993664:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191869.180412:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630993472
00000100:00100000:1.0:1776191869.180442:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630993856
00000100:00100000:1.0:1776191869.180460:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5202
00000100:00100000:1.0:1776191869.180464:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000061b94ee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630993472:12345-0@lo:400:kworker/u8:2.0
00010000:02020000:2.0:1776191869.180479:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191869.180550:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630993536
00000100:00100000:3.0:1776191869.180576:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3535
00000100:00100000:3.0:1776191869.180580:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000500f9601 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630993536:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191869.181635:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5203
00000100:00100000:0.0:1776191869.181640:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000008826861 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630993856:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191869.183081:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd341e03 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630993664:12345-0@lo:8:kworker/u8:2.0 Request processed in 2700us (2843us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191869.183095:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2584
00000100:00100000:2.0:1776191869.183128:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2585
00000100:00100000:2.0:1776191869.183133:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000819bd127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630993728:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191869.183378:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191869.183421:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000819bd127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467630993728:12345-0@lo:8:kworker/u8:2.0 Request processed in 287us (3144us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191869.183428:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2585
00000100:00080000:2.0:1776191869.183501:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191869.183505:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191869.183510:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f598cfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630993664:0@lo:8:kworker/u8:2.0
00000100:00080000:2.0:1776191869.183522:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191869.183525:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191869.183528:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000421d4a36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630993728:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191869.183580:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1b8127c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630993920:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191869.184958:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000061b94ee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630993472:12345-0@lo:400:kworker/u8:2.0 Request processed in 4487us (4788us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191869.184972:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5202
00000100:00100000:2.0:1776191869.185019:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191869.185026:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630993280
00000100:00100000:1.0:1776191869.185086:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1932
00000100:00100000:1.0:1776191869.185091:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002aaf4bb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630993280:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191869.185102:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e600ea8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630993216:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191869.185144:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002aaf4bb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630993280:12345-0@lo:400:kworker/u8:2.0 Request processed in 51us (4827us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191869.185152:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1932
00000100:00100000:2.0:1776191869.185178:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000481c290f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630993408:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191869.185212:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191869.185274:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630993920
00000100:00100000:1.0:1776191869.185302:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1782
00000100:00100000:1.0:1776191869.185306:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000421d4a36 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630993920:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191869.185327:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191869.185601:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000421d4a36 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630993920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 292us (583us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191869.185608:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1782
00000100:00100000:1.0:1776191869.185637:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000caebeb11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630993280:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191869.185651:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000994ca5e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630993472:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191869.185920:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005f9ce4ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630993536:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191869.185927:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000500f9601 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630993536:12345-0@lo:400:kworker/u8:2.0 Request processed in 5343us (5560us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191869.185937:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3535
00000100:00100000:3.0:1776191869.185960:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630993408
00000100:00100000:1.0:1776191869.185961:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1b8127c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630993920:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191869.185987:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3536
00000100:00100000:3.0:1776191869.185993:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001f598cfd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630993408:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191869.186009:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e56aacf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630993344:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191869.186031:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001f598cfd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630993408:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (817us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191869.186054:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3536
00000100:00100000:1.0:1776191869.186071:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191869.186089:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb4cf93d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630993600:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191869.186112:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191869.186141:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630993600
00000100:00100000:1.0:1776191869.186163:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2223
00000100:00100000:1.0:1776191869.186168:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000852fcdad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630993600:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191869.186189:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630993344
00000100:00100000:3.0:1776191869.186216:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5204
00000100:00100000:3.0:1776191869.186220:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000994ca5e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630993344:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191869.186259:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000994ca5e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467630993344:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (190us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191869.186266:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5204
00000100:00100000:3.0:1776191869.186298:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e56aacf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467630993344:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191869.186308:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000852fcdad pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630993600:12345-0@lo:400:kworker/u8:2.0 Request processed in 137us (194us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191869.186313:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb4cf93d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630993600:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191869.186320:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2223
00000100:00100000:2.0:1776191869.186821:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000481c290f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630993408:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191869.186830:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006821defb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630993792:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191869.186861:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191869.186985:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630993792
00000100:00100000:3.0:1776191869.187018:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5205
00000100:00100000:3.0:1776191869.187022:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb4cf93d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630993792:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191869.187204:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb4cf93d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630993792:12345-0@lo:400:kworker/u8:2.0 Request processed in 180us (343us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191869.187211:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5205
00000100:00100000:0.0:1776191869.187335:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000008826861 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630993856:12345-0@lo:400:kworker/u8:2.0 Request processed in 5692us (7094us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191869.187351:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5203
00000100:00100000:1.0:1776191869.187418:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a25bb0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630993856:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191869.187698:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006821defb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630993792:0@lo:400:kworker/u8:2.0
00010000:00010000:0.0:1776191869.946314:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191870.812075:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191870.812127:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191870.812706:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613827264
00000100:00100000:0.0:1776191870.812769:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5206
00000100:00100000:0.0:1776191870.812776:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003824609a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613827264:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191870.812857:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003824609a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613827264:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 80us (729us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191870.812865:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5206
00000100:00100000:3.0:1776191870.813498:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191870.813557:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613827328
00000100:00100000:1.0:1776191870.813596:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613827200
00000100:00100000:2.0:1776191870.813604:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5207
00000100:00100000:2.0:1776191870.813610:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008eb36e2d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613827328:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191870.813631:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1933
00000100:00100000:1.0:1776191870.813637:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027ca70f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613827200:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191870.813649:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008eb36e2d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613827328:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 37us (284us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191870.813657:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5207
00000100:00100000:1.0:1776191870.813675:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027ca70f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613827200:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 37us (1889us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191870.813682:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1933
00000100:00100000:0.0:1776191870.817119:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191870.817207:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613827392
00000100:00100000:2.0:1776191870.817320:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2224
00000100:00100000:2.0:1776191870.817327:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d80d649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613827392:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191870.817338:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191870.817399:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d80d649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613827392:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 71us (288us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191870.817407:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2224
00000100:00100000:2.0:1776191870.817423:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613827456
00000100:00100000:2.0:1776191870.817442:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2586
00000100:00100000:2.0:1776191870.817447:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081563597 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613827456:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:2.0:1776191870.817543:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191870.817572:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081563597 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613827456:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 124us (408us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191870.817579:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2586
00010000:00010000:3.0:1776191870.971012:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191871.996458:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191872.250452:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ee7172c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630993984:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191872.250519:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191872.250602:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630993984
00000100:00100000:1.0:1776191872.250671:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3537
00000100:00100000:1.0:1776191872.250677:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e56aacf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630993984:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191872.250710:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191872.259895:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e56aacf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630993984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9208us (9367us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191872.259920:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3537
00000100:00100000:3.0:1776191872.260244:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ee7172c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630993984:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191873.020730:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191873.275280:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191873.275297:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008ff2a89a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630994048:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191873.275386:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191873.275537:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630994048
00000100:00100000:3.0:1776191873.275596:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3538
00000100:00100000:3.0:1776191873.275601:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ecc8f95b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630994048:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191873.275650:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191873.275712:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ecc8f95b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630994048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (327us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191873.275722:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3538
00000100:00100000:1.0:1776191873.275945:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008ff2a89a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630994048:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191874.042286:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191874.298288:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776191874.298306:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008ff2a89a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630994112:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191874.298330:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1776191874.298339:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006821defb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630994176:0@lo:13:osp-pre-0-0.0
00000100:00080000:3.0:1776191874.298475:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191874.298480:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191874.298483:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191874.298488:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4407
00000100:00080000:3.0:1776191874.298490:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191874.298495:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191874.298521:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000005cfbecd5 x1862467630994688/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191874.298536:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191874.298540:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191874.298541:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191874.298544:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4407
00000100:00080000:3.0:1776191874.298546:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:3.0:1776191874.298549:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191874.298559:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000d808a8bb x1862467630994752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191874.298677:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027f5d17c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630994240:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191874.298735:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191874.298790:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000070835139 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630994304:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191874.300795:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191874.300858:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b044802b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630994368:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191874.300916:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191874.300936:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000096e89164 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630994624:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191874.300959:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191874.300979:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:2.0:1776191874.300986:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004905ea34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630994432:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191874.301010:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191874.301026:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000016dc0009 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630994816:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191874.301073:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191874.301235:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005cfbecd5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630994688:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191874.301275:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191874.301290:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d808a8bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630994752:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191874.301333:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191874.301374:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630994432
00000100:00100000:2.0:1776191874.301416:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630994816
00000100:00100000:2.0:1776191874.301447:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5208
00000100:00100000:2.0:1776191874.301452:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000caebeb11 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630994432:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191874.301503:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000caebeb11 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630994432:12345-0@lo:400:kworker/u8:4.0 Request processed in 49us (492us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191874.301510:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5208
00000100:00100000:2.0:1776191874.301528:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5209
00000100:00100000:2.0:1776191874.301532:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e600ea8b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630994816:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191874.301567:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e600ea8b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630994816:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (482us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191874.301574:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5209
00000100:00100000:2.0:1776191874.301596:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630994624
00000100:00100000:2.0:1776191874.301630:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630994688
00000100:00100000:2.0:1776191874.301644:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630994752
00000100:00100000:2.0:1776191874.301656:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2225
00000100:00100000:2.0:1776191874.301659:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000481c290f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630994624:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191874.301688:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000481c290f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630994624:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (728us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191874.301693:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2225
00000100:00100000:2.0:1776191874.301704:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2587
00000100:00100000:2.0:1776191874.301707:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d1c8a441 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630994688:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191874.301797:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191874.301827:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d1c8a441 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630994688:12345-0@lo:8:kworker/u8:4.0 Request processed in 118us (552us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191874.301833:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2587
00000100:00100000:2.0:1776191874.301843:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2588
00000100:00100000:2.0:1776191874.301846:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f61127c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630994752:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191874.301924:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191874.301946:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f61127c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630994752:12345-0@lo:8:kworker/u8:4.0 Request processed in 99us (614us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191874.301951:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2588
00000100:00100000:2.0:1776191874.301986:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630994368
00000100:00100000:2.0:1776191874.302008:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3539
00000100:00100000:2.0:1776191874.302012:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a25bb0a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630994368:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191874.302061:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a25bb0a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630994368:12345-0@lo:400:kworker/u8:4.0 Request processed in 48us (1145us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191874.302067:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3539
00000100:00080000:2.0:1776191874.302111:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191874.302116:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191874.302119:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005cfbecd5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630994688:0@lo:8:kworker/u8:4.0
00000100:00080000:2.0:1776191874.302129:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191874.302131:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191874.302134:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d808a8bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630994752:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191874.302164:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004905ea34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630994432:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191874.302180:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000016dc0009 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630994816:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191874.302192:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b044802b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630994368:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191874.302202:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000096e89164 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630994624:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191874.302270:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630994112
00000100:00100000:2.0:1776191874.302292:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630994176
00000100:00100000:2.0:1776191874.302306:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1783
00000100:00100000:2.0:1776191874.302309:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cfc3317d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630994112:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1776191874.302328:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191874.302358:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cfc3317d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630994112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (3625us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191874.302364:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1783
00000100:00100000:2.0:1776191874.302375:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1784
00000100:00100000:2.0:1776191874.302378:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005f9ce4ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630994176:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191874.302386:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191874.302411:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005f9ce4ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630994176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 32us (1624us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191874.302417:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1784
00000100:00100000:2.0:1776191874.302446:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006821defb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630994176:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191874.313078:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191874.313106:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008ff2a89a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630994112:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191874.313114:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008074d522 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630994496:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191874.313157:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191874.313347:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630994240
00000100:00100000:2.0:1776191874.313885:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1934
00000100:00100000:2.0:1776191874.313892:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb953a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630994240:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191874.314592:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191874.314634:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003135b5de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630994560:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191874.314670:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191874.314694:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191874.314700:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630994880:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191874.314733:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191874.314766:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630994304
00000100:00100000:3.0:1776191874.314796:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630994880
00000100:00100000:3.0:1776191874.314838:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5210
00000100:00100000:3.0:1776191874.314842:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc54e5ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630994304:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191874.314891:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc54e5ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630994304:12345-0@lo:400:kworker/u8:4.0 Request processed in 47us (300us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191874.314898:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5210
00000100:00100000:3.0:1776191874.314914:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5211
00000100:00100000:3.0:1776191874.314917:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090a9e988 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630994880:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191874.314940:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090a9e988 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630994880:12345-0@lo:400:kworker/u8:4.0 Request processed in 22us (207us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191874.314945:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5211
00000100:00100000:3.0:1776191874.314962:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630994560
00000100:00100000:3.0:1776191874.314979:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2226
00000100:00100000:3.0:1776191874.314983:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008611bf7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630994560:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191874.315009:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008611bf7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630994560:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (340us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191874.315015:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2226
00000100:00100000:3.0:1776191874.315072:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630994880:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191874.315086:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000070835139 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630994304:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191874.315093:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003135b5de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630994560:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191874.315337:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb953a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630994240:12345-0@lo:400:kworker/u8:4.0 Request processed in 1444us (2266us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191874.315346:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1934
00000100:00100000:0.0:1776191874.317396:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027f5d17c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630994240:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191874.318256:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630994496
00000100:00100000:1.0:1776191874.318317:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3540
00000100:00100000:1.0:1776191874.318323:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b668658 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630994496:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191874.318400:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b668658 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630994496:12345-0@lo:400:kworker/u8:4.0 Request processed in 76us (5244us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191874.318407:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3540
00000100:00100000:0.0:1776191874.318738:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008074d522 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630994496:0@lo:400:kworker/u8:4.0
00010000:00010000:0.0:1776191875.066913:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191875.935472:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191875.935554:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191875.935616:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191875.935645:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191875.935670:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191875.935731:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613827712
00000100:00100000:1.0:1776191875.935788:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613827776
00000100:00100000:1.0:1776191875.935807:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2227
00000100:00100000:1.0:1776191875.935813:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7098b67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613827712:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191875.935888:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7098b67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613827712:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 74us (333us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191875.935896:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2227
00000100:00100000:1.0:1776191875.935912:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2589
00000100:00100000:1.0:1776191875.935916:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004385f089 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613827776:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:1.0:1776191875.936023:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191875.936091:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004385f089 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613827776:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 174us (446us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191875.936109:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2589
00000100:00100000:2.0:1776191875.936965:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613827520
00000100:00100000:2.0:1776191875.937013:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1935
00000100:00100000:2.0:1776191875.937019:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a5cfa2a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613827520:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191875.937104:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a5cfa2a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613827520:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 84us (1488us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191875.937112:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1935
00000100:00100000:3.0:1776191875.937897:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613827584
00000100:00100000:3.0:1776191875.937941:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613827648
00000100:00100000:3.0:1776191875.938017:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5212
00000100:00100000:3.0:1776191875.938023:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b57c159 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613827584:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191875.938160:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b57c159 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613827584:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 136us (2695us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191875.938167:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5212
00000100:00100000:3.0:1776191875.938188:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5213
00000100:00100000:3.0:1776191875.938192:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005eac7f74 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613827648:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191875.938214:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005eac7f74 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613827648:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 21us (2545us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191875.938220:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5213
00010000:00010000:0.0:1776191876.092792:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191877.115763:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191877.371767:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191877.371784:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec6658fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630994944:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191877.371852:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191877.371940:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630994944
00000100:00100000:2.0:1776191877.371997:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3541
00000100:00100000:2.0:1776191877.372003:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008ff2a89a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630994944:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191877.373013:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191877.373096:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008ff2a89a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630994944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1091us (1244us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191877.373105:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3541
00000100:00100000:0.0:1776191877.373257:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec6658fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630994944:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191878.138227:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191878.396808:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776191878.396826:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027f5d17c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630995008:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191878.396904:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191878.396982:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630995008
00000100:00100000:3.0:1776191878.397027:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3542
00000100:00100000:3.0:1776191878.397049:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000054025811 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630995008:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191878.397080:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191878.397125:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000054025811 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630995008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (222us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191878.397132:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3542
00000100:00100000:1.0:1776191878.397217:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027f5d17c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630995008:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191879.164982:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191879.419622:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017340e28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630995200:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191879.419722:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f7ba46c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630995264:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191879.421428:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b750fcc1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630995072:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191879.421557:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191879.421658:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630995264
00000100:00080000:1.0:1776191879.421660:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191879.421667:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191879.421670:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191879.421675:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4412
00000100:00080000:1.0:1776191879.421678:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191879.421684:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191879.421705:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000086973b12 x1862467630995648/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191879.421709:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5214
00000100:00100000:0.0:1776191879.421719:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ec6658fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630995264:12345-0@lo:400:kworker/u8:4.0
00000100:00080000:1.0:1776191879.421727:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191879.421731:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191879.421733:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191879.421737:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4412
00000100:00080000:1.0:1776191879.421739:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 21s
00000100:00080000:1.0:1776191879.421742:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191879.421756:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000b8ecdd1c x1862467630995712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191879.421772:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ec6658fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467630995264:12345-0@lo:400:kworker/u8:4.0 Request processed in 53us (216us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191879.421782:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5214
00000100:00100000:1.0:1776191879.421796:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a64218bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630995136:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191879.421822:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003cf1d110 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630995520:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191879.421837:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191879.421859:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191879.421861:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ce06565 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630995392:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191879.421898:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f7ba46c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467630995264:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191879.421913:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191879.421919:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191879.421927:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c797efb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630995584:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191879.421935:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000099b06534 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630995776:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191879.421956:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191879.421968:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191879.421992:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630995520
00000100:00100000:1.0:1776191879.421994:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:1.0:1776191879.422002:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000d666725 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630995456:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191879.422022:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630995584
00000100:00100000:1.0:1776191879.422031:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191879.422067:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000759c01aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630995840:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191879.422080:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2228
00000100:00100000:0.0:1776191879.422085:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5f2099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630995520:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191879.422092:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191879.422121:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086973b12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630995648:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191879.422133:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5f2099 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467630995520:12345-0@lo:400:kworker/u8:4.0 Request processed in 46us (275us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191879.422140:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2228
00000100:00100000:1.0:1776191879.422149:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191879.422168:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8ecdd1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630995712:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191879.422186:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191879.423516:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630995648
00000100:00100000:0.0:1776191879.423581:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2229
00000100:00100000:0.0:1776191879.423589:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be4c283a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630995584:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191879.423672:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be4c283a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630995584:12345-0@lo:400:kworker/u8:4.0 Request processed in 83us (1717us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191879.423679:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2229
00000100:00100000:0.0:1776191879.423695:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590
00000100:00100000:0.0:1776191879.423699:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d511d550 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630995648:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191879.423800:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191879.423831:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d511d550 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630995648:12345-0@lo:8:kworker/u8:4.0 Request processed in 131us (1684us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191879.423838:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590
00000100:00100000:0.0:1776191879.423887:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c797efb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630995584:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191879.423901:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003cf1d110 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630995520:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191879.423963:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630995392
00000100:00100000:0.0:1776191879.423992:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630995776
00000100:00100000:0.0:1776191879.424023:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630995840
00000100:00100000:0.0:1776191879.424060:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5215
00000100:00100000:0.0:1776191879.424064:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000017188761 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630995392:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191879.424104:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000017188761 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467630995392:12345-0@lo:400:kworker/u8:4.0 Request processed in 38us (2192us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191879.424109:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5215
00000100:00100000:0.0:1776191879.424121:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5216
00000100:00100000:0.0:1776191879.424125:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d5838694 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630995776:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191879.424150:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d5838694 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467630995776:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (2184us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191879.424155:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5216
00000100:00100000:0.0:1776191879.424165:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5217
00000100:00100000:0.0:1776191879.424168:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008002d6a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630995840:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191879.424192:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008002d6a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467630995840:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (2102us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191879.424197:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5217
00000100:00100000:0.0:1776191879.424232:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630995136
00000100:00100000:0.0:1776191879.424255:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1936
00000100:00100000:0.0:1776191879.424259:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c7de7df8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630995136:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191879.424287:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c7de7df8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630995136:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (2452us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191879.424292:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1936
00000100:00100000:0.0:1776191879.424424:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630995456
00000100:00100000:0.0:1776191879.424449:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3543
00000100:00100000:0.0:1776191879.424453:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e7bcf21 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630995456:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191879.424483:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e7bcf21 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630995456:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (2454us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191879.424488:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3543
00000100:00100000:0.0:1776191879.424550:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000d666725 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630995456:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191879.424562:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000759c01aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467630995840:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191879.424570:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a64218bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630995136:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191879.424579:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ce06565 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467630995392:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191879.424589:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000099b06534 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467630995776:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191879.424656:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191879.424684:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630995200
00000100:00100000:0.0:1776191879.424713:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1785
00000100:00100000:0.0:1776191879.424718:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070835139 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630995200:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191879.424740:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191879.424784:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070835139 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630995200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (130us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191879.424789:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1785
00000100:00100000:3.0:1776191879.425456:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017340e28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630995200:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191879.427824:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191879.427868:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006dc48ca9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630995328:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191879.427910:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191879.427958:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630995328
00000100:00100000:2.0:1776191879.427995:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3544
00000100:00100000:2.0:1776191879.428001:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e724e007 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630995328:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191879.428059:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e724e007 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630995328:12345-0@lo:400:kworker/u8:4.0 Request processed in 58us (149us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191879.428066:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3544
00000100:00100000:2.0:1776191879.428107:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006dc48ca9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630995328:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191879.428177:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630995712
00000100:00080000:1.0:1776191879.428181:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191879.428187:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191879.428192:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086973b12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630995648:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191879.428202:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2591
00000100:00100000:2.0:1776191879.428208:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000badc4b3e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630995712:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191879.428301:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191879.428341:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000badc4b3e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630995712:12345-0@lo:8:kworker/u8:4.0 Request processed in 133us (6154us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191879.428348:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2591
00000100:00080000:1.0:1776191879.428393:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191879.428397:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191879.428400:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8ecdd1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630995712:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191879.429599:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630995072
00000100:00100000:0.0:1776191879.429660:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1786
00000100:00100000:0.0:1776191879.429665:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000acbe1ca8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630995072:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191879.429687:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191879.429751:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000acbe1ca8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630995072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (1936us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191879.429758:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1786
00000100:00100000:2.0:1776191879.429933:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b750fcc1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630995072:0@lo:13:osp-pre-0-0.0
00010000:00010000:3.0:1776191880.186462:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191881.056097:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191881.056135:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191881.056299:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613827904
00000100:00100000:1.0:1776191881.056357:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5218
00000100:00100000:1.0:1776191881.056366:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b750fcc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613827904:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191881.056447:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b750fcc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613827904:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 82us (312us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191881.056455:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5218
00000100:00100000:0.0:1776191881.056548:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613827840
00000100:00100000:0.0:1776191881.056586:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1937
00000100:00100000:0.0:1776191881.056591:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000071188990 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613827840:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191881.056631:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071188990 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613827840:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 39us (541us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191881.056637:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1937
00000100:00100000:2.0:1776191881.056840:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191881.056907:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191881.056972:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613827968
00000100:00100000:1.0:1776191881.057004:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5219
00000100:00100000:1.0:1776191881.057008:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030d50eb4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613827968:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191881.057071:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030d50eb4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613827968:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 61us (232us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191881.057078:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5219
00000100:00100000:3.0:1776191881.057463:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613828096
00000100:00100000:3.0:1776191881.057505:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2592
00000100:00100000:3.0:1776191881.057509:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bd6ad1ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613828096:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:3.0:1776191881.057697:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191881.057965:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bd6ad1ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613828096:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 454us (1057us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191881.057973:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2592
00000100:00100000:2.0:1776191881.059695:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191881.059794:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613828032
00000100:00100000:3.0:1776191881.059877:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2230
00000100:00100000:3.0:1776191881.059883:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ca4bb8b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613828032:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191881.059945:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ca4bb8b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613828032:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 62us (256us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191881.059959:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2230
00010000:00010000:0.0:1776191881.210743:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191882.234271:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191882.490196:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009d80d649 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630995904:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191882.490281:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191882.490395:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630995904
00000100:00100000:2.0:1776191882.490469:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3545
00000100:00100000:2.0:1776191882.490475:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b8ecdd1c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630995904:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191882.490509:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191882.490561:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b8ecdd1c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630995904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (280us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191882.490568:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3545
00000100:00100000:1.0:1776191882.490606:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009d80d649 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630995904:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191883.258752:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191883.516142:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027f5d17c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630995968:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191883.516225:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191883.516545:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630995968
00000100:00100000:0.0:1776191883.516599:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3546
00000100:00100000:0.0:1776191883.516605:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000050883ee9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630995968:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191883.516641:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191883.516698:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000050883ee9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630995968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (474us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191883.516706:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3546
00000100:00100000:1.0:1776191883.516866:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027f5d17c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630995968:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191884.283768:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1776191884.538288:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191884.538296:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191884.538300:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191884.538309:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4417
00000100:00080000:1.0:1776191884.538315:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 6s
00000100:00080000:1.0:1776191884.538322:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191884.538346:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000006586b752 x1862467630996608/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191884.538360:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000005cfbb60 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630996224:0@lo:400:kworker/u8:2.0
00000100:00080000:1.0:1776191884.538362:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191884.538369:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191884.538371:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191884.538374:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4417
00000100:00080000:1.0:1776191884.538376:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 6s
00000100:00080000:1.0:1776191884.538379:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191884.538391:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000009ff74e59 x1862467630996672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191884.538440:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006586b752 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630996608:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191884.538451:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191884.538506:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003c5d30dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630996096:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191884.538517:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086973b12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630996032:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191884.541609:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191884.541659:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ff74e59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630996672:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191884.541706:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191884.541761:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630996608
00000100:00100000:1.0:1776191884.541794:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593
00000100:00100000:1.0:1776191884.541800:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006dc48ca9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630996608:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:1.0:1776191884.541900:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191884.541940:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006dc48ca9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630996608:12345-0@lo:8:kworker/u8:2.0 Request processed in 140us (355us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191884.541948:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593
00000100:00100000:1.0:1776191884.541965:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630996672
00000100:00100000:1.0:1776191884.541982:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594
00000100:00100000:1.0:1776191884.541999:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000099b06534 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630996672:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:1.0:1776191884.542102:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191884.542127:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000099b06534 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630996672:12345-0@lo:8:kworker/u8:2.0 Request processed in 140us (421us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191884.542133:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594
00000100:00080000:1.0:1776191884.542168:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191884.542183:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191884.542187:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006586b752 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630996608:0@lo:8:kworker/u8:2.0
00000100:00080000:1.0:1776191884.542198:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191884.542200:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191884.542202:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ff74e59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630996672:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191884.542246:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630996224
00000100:00100000:1.0:1776191884.542274:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5220
00000100:00100000:1.0:1776191884.542278:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008ff5ba12 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630996224:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191884.542317:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008ff5ba12 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630996224:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (3869us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191884.542323:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5220
00000100:00100000:1.0:1776191884.542367:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c5ae3e62 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630996160:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191884.542392:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191884.542419:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ecf3ccc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630996416:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191884.542437:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191884.542449:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000badc4b3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630996800:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191884.542470:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191884.542497:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630996416
00000100:00100000:1.0:1776191884.542520:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2231
00000100:00100000:1.0:1776191884.542524:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006586b752 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630996416:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191884.542554:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006586b752 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467630996416:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (116us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191884.542560:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2231
00000100:00100000:1.0:1776191884.542577:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630996800
00000100:00100000:1.0:1776191884.542594:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5221
00000100:00100000:1.0:1776191884.542597:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ce06565 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630996800:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191884.542621:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ce06565 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630996800:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (151us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191884.542627:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5221
00000100:00100000:1.0:1776191884.542651:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ecf3ccc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467630996416:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191884.542659:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000badc4b3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630996800:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191884.542685:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630996160
00000100:00100000:1.0:1776191884.542707:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3547
00000100:00100000:1.0:1776191884.542711:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ff74e59 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630996160:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191884.542740:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ff74e59 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630996160:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (348us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191884.542750:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3547
00000100:00100000:1.0:1776191884.542771:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c5ae3e62 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630996160:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191884.543506:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000005cfbb60 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630996224:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191884.543519:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c98e876 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630996480:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191884.543556:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191884.545361:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630996480
00000100:00100000:1.0:1776191884.545429:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1787
00000100:00100000:1.0:1776191884.545437:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007e2b3438 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630996480:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191884.545468:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191884.545536:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007e2b3438 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630996480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (1980us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191884.545544:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1787
00000100:00100000:2.0:1776191884.547028:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c98e876 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630996480:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191884.547984:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191884.548188:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bf589eef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630996352:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191884.548233:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191884.548264:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d511d550 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630996736:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191884.548332:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630996352
00000100:00100000:2.0:1776191884.548374:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2232
00000100:00100000:2.0:1776191884.548379:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb97b35c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630996352:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191884.548752:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630996096
00000100:00100000:1.0:1776191884.548784:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5222
00000100:00100000:1.0:1776191884.548788:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027f5d17c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630996096:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191884.548915:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191884.548979:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630996736
00000100:00100000:3.0:1776191884.549015:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5223
00000100:00100000:3.0:1776191884.549019:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000068cadb2f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630996736:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191884.549072:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000068cadb2f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630996736:12345-0@lo:400:kworker/u8:2.0 Request processed in 52us (158us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191884.549080:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5223
00000100:00100000:3.0:1776191884.549114:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d511d550 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630996736:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191884.549659:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191884.549697:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9664b8e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630996288:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191884.549731:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191884.549748:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d698ed89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630996544:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191884.549770:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191884.549803:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630996288
00000100:00100000:0.0:1776191884.550063:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3548
00000100:00100000:0.0:1776191884.550069:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081563597 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630996288:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191884.550243:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081563597 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630996288:12345-0@lo:400:kworker/u8:2.0 Request processed in 172us (511us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191884.550250:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3548
00000100:00100000:0.0:1776191884.550272:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630996544
00000100:00100000:0.0:1776191884.550294:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1788
00000100:00100000:0.0:1776191884.550298:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7098b67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630996544:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191884.550313:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191884.550518:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7098b67 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630996544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 218us (746us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191884.550525:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1788
00000100:00100000:0.0:1776191884.550646:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9664b8e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630996288:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191884.550664:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d698ed89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630996544:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191884.551026:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630996032
00000100:00100000:3.0:1776191884.551085:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1938
00000100:00100000:3.0:1776191884.551090:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c42de81a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630996032:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191884.551131:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c42de81a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630996032:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (1475us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191884.551137:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1938
00000100:00100000:0.0:1776191884.551194:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086973b12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630996032:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191884.552326:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb97b35c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467630996352:12345-0@lo:400:kworker/u8:2.0 Request processed in 3940us (4088us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191884.552339:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2232
00000100:00100000:3.0:1776191884.552548:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bf589eef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630996352:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191884.552588:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027f5d17c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630996096:12345-0@lo:400:kworker/u8:2.0 Request processed in 3797us (4605us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191884.552598:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5222
00000100:00100000:3.0:1776191884.552754:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003c5d30dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630996096:0@lo:400:kworker/u8:2.0
00010000:00010000:0.0:1776191885.307939:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191886.176185:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191886.176318:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191886.176507:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191886.176538:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191886.176634:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191886.176698:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613828288
00000100:00100000:1.0:1776191886.176764:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613828224
00000100:00100000:1.0:1776191886.176788:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5224
00000100:00100000:1.0:1776191886.176795:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd5f2099 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613828288:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191886.176899:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd5f2099 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613828288:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 103us (540us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191886.176909:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5224
00000100:00100000:1.0:1776191886.176930:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5225
00000100:00100000:1.0:1776191886.176937:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be4c283a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613828224:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191886.176967:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be4c283a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613828224:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 31us (429us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191886.176974:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5225
00000100:00100000:2.0:1776191886.177263:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613828160
00000100:00100000:2.0:1776191886.177304:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1939
00000100:00100000:2.0:1776191886.177308:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc7ff80b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613828160:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191886.177337:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc7ff80b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613828160:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 28us (1021us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191886.177348:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1939
00000100:00100000:3.0:1776191886.180190:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613828416
00000100:00100000:3.0:1776191886.180864:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613828352
00000100:00100000:3.0:1776191886.181087:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2233
00000100:00100000:3.0:1776191886.181095:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ee7172c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613828352:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191886.181152:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2595
00000100:00100000:1.0:1776191886.181159:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004385f089 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613828416:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:1.0:1776191886.181271:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191886.181314:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ee7172c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613828352:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 218us (4678us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191886.181326:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2233
00000100:00100000:1.0:1776191886.181349:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004385f089 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613828416:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 189us (5179us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191886.181356:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2595
00010000:00010000:3.0:1776191886.331447:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191887.354531:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191887.610475:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1b8127c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630996864:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191887.610560:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191887.610988:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630996864
00000100:00100000:0.0:1776191887.611079:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3549
00000100:00100000:0.0:1776191887.611085:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c98e876 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630996864:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191887.611119:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191887.611178:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c98e876 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630996864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (619us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191887.611185:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3549
00000100:00100000:3.0:1776191887.611320:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1b8127c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630996864:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191888.379201:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191888.635223:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1fe5010 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630996928:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191888.635295:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191888.635349:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630996928
00000100:00100000:2.0:1776191888.635398:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3550
00000100:00100000:2.0:1776191888.635403:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a1b8127c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630996928:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191888.635474:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191888.635534:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a1b8127c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630996928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (239us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191888.635541:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3550
00000100:00100000:1.0:1776191888.635661:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1fe5010 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630996928:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191889.402273:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1776191889.658251:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191889.658258:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191889.658262:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191889.658270:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4422
00000100:00080000:1.0:1776191889.658274:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 11s
00000100:00080000:1.0:1776191889.658279:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191889.658310:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000c797efb1 x1862467630997440/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191889.658329:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191889.658332:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191889.658333:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191889.658336:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4422
00000100:00080000:1.0:1776191889.658338:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 11s
00000100:00080000:1.0:1776191889.658341:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191889.658351:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000006f7ba46c x1862467630997504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191889.658394:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c797efb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630997440:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191889.658430:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ecf3ccc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630997120:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191889.658462:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191889.658489:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f7ba46c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630997504:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191889.658564:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191889.658583:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003cf1d110 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630997376:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191889.658605:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191889.658628:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:3.0:1776191889.658634:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000badc4b3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630997056:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191889.658656:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191889.658668:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000d666725 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630997312:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191889.658698:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191889.658734:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630997440
00000100:00100000:3.0:1776191889.658765:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630997376
00000100:00100000:3.0:1776191889.658788:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630997312
00000100:00100000:3.0:1776191889.658804:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2234
00000100:00100000:3.0:1776191889.658811:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f9388e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630997376:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191889.658859:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f9388e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630997376:12345-0@lo:400:kworker/u8:2.0 Request processed in 49us (253us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191889.658866:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2234
00000100:00100000:3.0:1776191889.658881:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2235
00000100:00100000:3.0:1776191889.658885:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1fe5010 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630997312:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191889.658910:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1fe5010 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630997312:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (212us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191889.658915:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2235
00000100:00100000:3.0:1776191889.658926:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596
00000100:00100000:3.0:1776191889.658929:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000086973b12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630997440:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191889.659026:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191889.659339:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000086973b12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467630997440:12345-0@lo:8:kworker/u8:2.0 Request processed in 408us (878us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191889.659347:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596
00000100:00100000:3.0:1776191889.659377:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c5ae3e62 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630996992:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191889.659406:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191889.659424:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000759c01aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630997248:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191889.659446:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191889.659564:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bf589eef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630997632:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191889.659644:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191889.659662:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:3.0:1776191889.659667:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a64218bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630997184:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191889.659689:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191889.659705:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003c5d30dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630997568:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191889.659726:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191889.659753:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630997056
00000100:00100000:3.0:1776191889.659817:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630997632
00000100:00100000:3.0:1776191889.659835:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5226
00000100:00100000:3.0:1776191889.659839:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048707662 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630997056:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191889.659872:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048707662 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630997056:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (1215us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191889.659878:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5226
00000100:00100000:3.0:1776191889.659891:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630997184
00000100:00100000:3.0:1776191889.659907:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630997568
00000100:00100000:3.0:1776191889.659918:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5227
00000100:00100000:3.0:1776191889.659923:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d0c84519 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630997632:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191889.659955:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d0c84519 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467630997632:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (312us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191889.659961:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5227
00000100:00100000:3.0:1776191889.659973:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5228
00000100:00100000:3.0:1776191889.659976:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009916a1d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630997184:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191889.660000:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009916a1d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630997184:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (310us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191889.660005:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5228
00000100:00100000:3.0:1776191889.660015:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5229
00000100:00100000:3.0:1776191889.660018:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b847a9ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630997568:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191889.660479:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b847a9ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630997568:12345-0@lo:400:kworker/u8:2.0 Request processed in 458us (752us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191889.660486:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5229
00000100:00100000:3.0:1776191889.660526:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a64218bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630997184:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191889.660535:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003c5d30dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630997568:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191889.660544:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bf589eef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467630997632:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191889.660574:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000badc4b3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630997056:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191889.660585:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000d666725 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630997312:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191889.660595:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003cf1d110 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630997376:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191889.660655:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630996992
00000100:00100000:3.0:1776191889.660726:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1940
00000100:00100000:3.0:1776191889.660730:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bcb4f46f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630996992:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191889.660765:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bcb4f46f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467630996992:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (1359us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191889.660771:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1940
00000100:00100000:3.0:1776191889.660801:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c5ae3e62 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467630996992:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191889.660928:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191889.661127:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191889.661131:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191889.661135:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c797efb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630997440:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191889.661292:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630997120
00000100:00100000:1.0:1776191889.661309:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1776191889.661318:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630997248
00000100:00100000:1.0:1776191889.661322:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c797efb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630997696:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191889.661336:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3551
00000100:00100000:2.0:1776191889.661341:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000044860d59 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630997120:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191889.661353:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191889.661396:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000044860d59 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467630997120:12345-0@lo:400:kworker/u8:2.0 Request processed in 52us (2832us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191889.661403:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3551
00000100:00100000:1.0:1776191889.661405:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ecf3ccc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630997120:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191889.661424:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3552
00000100:00100000:2.0:1776191889.661441:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000b9cbeaa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630997248:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191889.661442:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630997504
00000100:00100000:3.0:1776191889.661471:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2597
00000100:00100000:3.0:1776191889.661476:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9664b8e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630997504:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191889.661485:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000b9cbeaa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467630997248:12345-0@lo:400:kworker/u8:2.0 Request processed in 44us (2038us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191889.661492:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3552
00000100:00100000:1.0:1776191889.661561:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000759c01aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467630997248:0@lo:400:kworker/u8:2.0
00010000:02020000:3.0:1776191889.661568:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191889.661608:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9664b8e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630997504:12345-0@lo:8:kworker/u8:2.0 Request processed in 132us (680us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191889.661615:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2597
00000100:00080000:1.0:1776191889.663231:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191889.663241:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191889.663246:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f7ba46c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630997504:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191889.664553:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630997696
00000100:00100000:0.0:1776191889.664607:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1789
00000100:00100000:0.0:1776191889.664614:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d511d550 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630997696:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191889.664647:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191889.664710:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d511d550 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630997696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (3358us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191889.664717:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1789
00000100:00100000:0.0:1776191889.664770:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c797efb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630997696:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191889.665047:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000090a5e0f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630997760:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191889.665079:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191889.665141:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630997760
00000100:00100000:2.0:1776191889.665163:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1790
00000100:00100000:2.0:1776191889.665167:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d80d649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630997760:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191889.665177:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191889.665209:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d80d649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630997760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (130us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191889.665214:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1790
00000100:00100000:0.0:1776191889.665268:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000090a5e0f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630997760:0@lo:13:osp-pre-0-0.0
00010000:00010000:0.0:1776191890.426223:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191891.290366:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191891.290415:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191891.290451:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191891.290483:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191891.290506:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191891.290598:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613828608
00000100:00100000:0.0:1776191891.290653:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613828544
00000100:00100000:0.0:1776191891.290675:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5230
00000100:00100000:0.0:1776191891.290681:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005a62d460 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613828608:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191891.290755:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005a62d460 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613828608:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 73us (340us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191891.290762:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5230
00000100:00100000:0.0:1776191891.290781:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5231
00000100:00100000:0.0:1776191891.290785:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000a8378fa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613828544:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191891.290808:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000a8378fa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613828544:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 23us (325us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191891.290814:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5231
00000100:00100000:0.0:1776191891.290833:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613828736
00000100:00100000:0.0:1776191891.290851:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613828672
00000100:00100000:0.0:1776191891.290869:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2236
00000100:00100000:0.0:1776191891.290873:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000071dfa1cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613828672:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191891.290898:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071dfa1cb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613828672:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 24us (392us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191891.290904:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2236
00000100:00100000:0.0:1776191891.290915:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2598
00000100:00100000:0.0:1776191891.290918:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd00ffe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613828736:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:0.0:1776191891.291015:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191891.291076:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd00ffe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2262:x1862467613828736:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 157us (625us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191891.291083:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2598
00000100:00100000:1.0:1776191891.291380:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613828480
00000100:00100000:1.0:1776191891.291421:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1941
00000100:00100000:1.0:1776191891.291425:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ac96f048 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613828480:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191891.291461:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ac96f048 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613828480:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 34us (1102us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191891.291470:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1941
00010000:00010000:0.0:1776191891.453583:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191892.475192:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191892.730630:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008074d522 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630997824:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191892.730718:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191892.731154:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630997824
00000100:00100000:0.0:1776191892.732929:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3553
00000100:00100000:0.0:1776191892.732941:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000023d9198f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630997824:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191892.732983:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191892.733077:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000023d9198f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630997824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (2360us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191892.733084:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3553
00000100:00100000:3.0:1776191892.734432:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008074d522 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630997824:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191893.498827:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191893.754214:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776191893.754234:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5f06cb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630997888:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191893.754308:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191893.754340:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630997888
00000100:00100000:1.0:1776191893.754445:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3554
00000100:00100000:1.0:1776191893.754451:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008074d522 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630997888:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191893.754483:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191893.754537:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008074d522 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630997888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (229us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191893.754545:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3554
00000100:00100000:3.0:1776191893.754633:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5f06cb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630997888:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191894.522281:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191894.780335:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191894.780368:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be2f7060 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630997952:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191894.780451:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191894.780731:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630997952
00000100:00100000:2.0:1776191894.780780:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1791
00000100:00100000:2.0:1776191894.780786:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d1c8a441 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630997952:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191894.780814:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191894.780863:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d1c8a441 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630997952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (413us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191894.780869:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1791
00000100:00100000:3.0:1776191894.780959:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be2f7060 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630997952:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191894.781266:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f7ba46c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630998016:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191894.781295:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191894.781322:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630998016
00000100:00100000:1.0:1776191894.781365:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1792
00000100:00100000:1.0:1776191894.781369:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000759c01aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630998016:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191894.781379:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191894.781406:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000759c01aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630998016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (110us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191894.781412:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1792
00000100:00100000:2.0:1776191894.781893:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5f06cb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630998080:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191894.781926:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191894.782601:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630998080
00000100:00100000:0.0:1776191894.782656:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1942
00000100:00100000:0.0:1776191894.782662:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b37044fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630998080:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191894.782710:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b37044fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467630998080:12345-0@lo:400:kworker/u8:4.0 Request processed in 48us (783us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191894.782716:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1942
00000100:00100000:0.0:1776191894.782767:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5f06cb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467630998080:0@lo:400:kworker/u8:4.0
00000100:00080000:3.0:1776191894.788453:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191894.788460:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191894.788463:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191894.788471:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4427
00000100:00080000:3.0:1776191894.788474:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 16s
00000100:00080000:3.0:1776191894.788481:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191894.788499:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000000cddb455 x1862467630998400/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191894.788515:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191894.788518:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191894.788519:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191894.788522:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4427
00000100:00080000:3.0:1776191894.788523:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 16s
00000100:00080000:3.0:1776191894.788527:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191894.788537:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000004a22f9ff x1862467630998464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191894.788582:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000cddb455 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630998400:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191894.788600:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5f06cb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630998208:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191894.788641:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191894.788641:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191894.788700:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d1ba4a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630998336:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191894.789956:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000852fcdad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630998144:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191894.790595:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1da7374 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630998592:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191894.793526:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191894.793648:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000481c290f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630998272:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191894.793704:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191894.793753:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f7ba46c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630998016:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191894.793803:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630998208
00000100:00100000:0.0:1776191894.793838:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630998336
00000100:00100000:0.0:1776191894.793854:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3555
00000100:00100000:0.0:1776191894.793859:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ba2914d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630998208:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191894.793907:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ba2914d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467630998208:12345-0@lo:400:kworker/u8:4.0 Request processed in 47us (5266us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191894.793914:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3555
00000100:00100000:0.0:1776191894.793928:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3556
00000100:00100000:0.0:1776191894.793932:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a96a54e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630998336:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191894.793961:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a96a54e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630998336:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (442us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191894.793966:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3556
00000100:00100000:0.0:1776191894.793996:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d1ba4a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630998336:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191894.794023:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630998272
00000100:00100000:3.0:1776191894.794067:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630998400
00000100:00100000:0.0:1776191894.794072:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5232
00000100:00100000:0.0:1776191894.794077:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008611bf7d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630998272:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191894.794098:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599
00000100:00100000:3.0:1776191894.794104:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a98c80a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630998400:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191894.794115:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008611bf7d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467630998272:12345-0@lo:400:kworker/u8:4.0 Request processed in 37us (410us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191894.794122:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5232
00000100:00100000:0.0:1776191894.794146:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000481c290f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467630998272:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191894.795027:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191894.795065:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b2bebc0b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630998528:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191894.795094:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191894.795135:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630998144
00000100:00100000:1.0:1776191894.795161:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630998528
00000100:00100000:0.0:1776191894.795665:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5233
00000100:00100000:0.0:1776191894.795672:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ecf3ccc7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630998144:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191894.795723:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ecf3ccc7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630998144:12345-0@lo:400:kworker/u8:4.0 Request processed in 51us (699us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191894.795729:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5233
00000100:00100000:0.0:1776191894.795746:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5234
00000100:00100000:0.0:1776191894.795749:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000005cfbb60 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630998528:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191894.795777:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000005cfbb60 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467630998528:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (683us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191894.795782:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5234
00000100:00100000:0.0:1776191894.795855:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000852fcdad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630998144:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191894.795866:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b2bebc0b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467630998528:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191894.795896:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a22f9ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630998464:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191894.795924:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191894.795950:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630998464
00000100:00100000:0.0:1776191894.795971:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600
00000100:00100000:0.0:1776191894.795975:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000188ce8c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630998464:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191894.796049:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191894.796085:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a98c80a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630998400:12345-0@lo:8:kworker/u8:4.0 Request processed in 1981us (7445us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191894.796093:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599
00010000:02020000:0.0:1776191894.796110:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191894.796139:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000188ce8c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467630998464:12345-0@lo:8:kworker/u8:4.0 Request processed in 163us (215us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191894.796146:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600
00000100:00080000:0.0:1776191894.796184:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191894.796189:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191894.796192:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000cddb455 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630998400:0@lo:8:kworker/u8:4.0
00000100:00080000:0.0:1776191894.796203:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191894.796206:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191894.796208:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a22f9ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630998464:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191894.801820:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191894.801898:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5f06cb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467630998208:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191894.802079:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630998592
00000100:00100000:1.0:1776191894.802124:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5235
00000100:00100000:1.0:1776191894.802130:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ccbf0ff6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630998592:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191894.802200:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ccbf0ff6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467630998592:12345-0@lo:400:kworker/u8:4.0 Request processed in 68us (385us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191894.802206:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5235
00000100:00100000:2.0:1776191894.802491:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1da7374 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467630998592:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191895.547797:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191896.417477:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191896.417522:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191896.417567:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191896.417596:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191896.417735:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613828800
00000100:00100000:3.0:1776191896.417787:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1943
00000100:00100000:1.0:1776191896.417791:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613828992
00000100:00100000:3.0:1776191896.417795:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004e50600 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613828800:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191896.417826:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2237
00000100:00100000:1.0:1776191896.417843:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003cd04cf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613828992:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191896.417864:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004e50600 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613828800:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 69us (295us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191896.417873:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1943
00000100:00100000:1.0:1776191896.417880:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003cd04cf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613828992:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 36us (357us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191896.417889:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2237
00000100:00100000:0.0:1776191896.417916:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613828928
00000100:00100000:1.0:1776191896.417916:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613828864
00000100:00100000:1.0:1776191896.417949:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5236
00000100:00100000:1.0:1776191896.417954:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df010b79 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613828864:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191896.417989:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df010b79 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613828864:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 35us (520us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191896.417995:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5236
00000100:00100000:1.0:1776191896.418007:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5237
00000100:00100000:1.0:1776191896.418011:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f95d0754 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613828928:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191896.418062:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f95d0754 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613828928:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 20us (437us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191896.418067:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5237
00000100:00100000:2.0:1776191896.418131:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191896.418278:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613829056
00000100:00100000:2.0:1776191896.418313:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2601
00000100:00100000:2.0:1776191896.418318:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cf4f5e1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613829056:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:2.0:1776191896.418410:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191896.418445:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cf4f5e1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613829056:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 126us (315us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191896.418452:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2601
00010000:00010000:0.0:1776191896.570745:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191897.594499:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191897.850408:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5f06cb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630998656:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191897.850495:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191897.850796:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630998656
00000100:00100000:0.0:1776191897.850849:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3557
00000100:00100000:0.0:1776191897.850856:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a1da7374 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630998656:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191897.850903:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191897.850960:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a1da7374 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630998656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (475us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191897.850968:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3557
00000100:00100000:3.0:1776191897.851069:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5f06cb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630998656:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191898.622363:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191898.875688:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a22f9ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630998720:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191898.875755:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191898.875862:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630998720
00000100:00100000:2.0:1776191898.875909:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3558
00000100:00100000:2.0:1776191898.875915:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000852fcdad pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630998720:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191898.875947:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191898.876000:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000852fcdad pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630998720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (245us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191898.876007:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3558
00000100:00100000:3.0:1776191898.876143:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a22f9ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630998720:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191899.643012:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191899.898227:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191899.898249:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004a22f9ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630998784:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191899.898253:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191899.898269:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be2f7060 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630999040:0@lo:400:kworker/u8:4.0
00000100:00080000:2.0:1776191899.898280:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191899.898285:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191899.898288:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191899.898292:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4432
00000100:00080000:2.0:1776191899.898296:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1776191899.898301:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191899.898320:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191899.898352:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000dd341e03 x1862467630999360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191899.898364:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191899.898367:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191899.898368:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191899.898371:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4432
00000100:00080000:2.0:1776191899.898373:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1776191899.898376:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191899.898387:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000819bd127 x1862467630999424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191899.898719:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f7ba46c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630998912:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191899.898789:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd341e03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630999360:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191899.904303:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191899.905707:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f61127c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630999232:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191899.905835:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191899.905853:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191899.905858:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017340e28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630999296:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191899.905879:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191899.905920:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630999232
00000100:00100000:3.0:1776191899.906298:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630999296
00000100:00100000:3.0:1776191899.907411:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2238
00000100:00100000:3.0:1776191899.907431:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b2bebc0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630999232:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191899.907440:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aaefa947 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630998976:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191899.907507:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191899.907512:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b2bebc0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467630999232:12345-0@lo:400:kworker/u8:4.0 Request processed in 90us (1676us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191899.907521:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2238
00000100:00100000:3.0:1776191899.907540:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2239
00000100:00100000:3.0:1776191899.907545:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009eabfd74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630999296:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191899.907572:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630998784
00000100:00100000:3.0:1776191899.907577:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009eabfd74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3363:x1862467630999296:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (1697us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191899.907584:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2239
00000100:00100000:1.0:1776191899.907606:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1793
00000100:00100000:1.0:1776191899.907611:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007eed40f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630998784:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191899.907634:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017340e28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630999296:0@lo:400:kworker/u8:4.0
00002000:00000024:1.0:1776191899.907635:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191899.907650:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f61127c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630999232:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191899.907678:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007eed40f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630998784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (9356us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191899.907686:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004a22f9ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630998784:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191899.907688:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1793
00000100:00100000:1.0:1776191899.908076:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cebeb50f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630998848:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191899.908081:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630998976
00000100:00100000:3.0:1776191899.908116:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5238
00000100:00100000:3.0:1776191899.908120:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c5ae3e62 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630998976:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191899.908132:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191899.908151:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000090a5e0f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630999104:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191899.908172:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191899.908192:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006821defb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630999488:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191899.908234:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191899.908324:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c5ae3e62 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467630998976:12345-0@lo:400:kworker/u8:4.0 Request processed in 202us (817us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191899.908331:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5238
00000100:00100000:1.0:1776191899.908347:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630999040
00000100:00100000:3.0:1776191899.908348:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630999104
00000100:00100000:3.0:1776191899.908377:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630999488
00000100:00100000:1.0:1776191899.908384:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3559
00000100:00100000:1.0:1776191899.908389:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c797efb1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630999040:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191899.908400:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5239
00000100:00100000:3.0:1776191899.908405:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d511d550 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630999104:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191899.908425:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c797efb1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630999040:12345-0@lo:400:kworker/u8:4.0 Request processed in 35us (4128us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191899.908431:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3559
00000100:00100000:1.0:1776191899.908456:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5240
00000100:00100000:1.0:1776191899.908460:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000759c01aa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630999488:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191899.908499:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d511d550 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467630999104:12345-0@lo:400:kworker/u8:4.0 Request processed in 92us (325us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191899.908503:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000759c01aa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467630999488:12345-0@lo:400:kworker/u8:4.0 Request processed in 40us (267us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191899.908510:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5239
00000100:00100000:1.0:1776191899.908519:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5240
00000100:00100000:3.0:1776191899.908537:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630998848
00000100:00100000:3.0:1776191899.908562:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1944
00000100:00100000:3.0:1776191899.908566:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f9005e31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630998848:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191899.908699:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f9005e31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630998848:12345-0@lo:400:kworker/u8:4.0 Request processed in 132us (569us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191899.908705:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1944
00000100:00100000:3.0:1776191899.908811:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cebeb50f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630998848:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191899.908821:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000090a5e0f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467630999104:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191899.908829:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006821defb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467630999488:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191899.909106:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191899.911391:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be2f7060 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630999040:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191899.911439:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aaefa947 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467630998976:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191899.911811:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630998912
00000100:00100000:3.0:1776191899.911854:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1794
00000100:00100000:3.0:1776191899.911860:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af393e55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630998912:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191899.911883:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191899.911936:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af393e55 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467630998912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (2831us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191899.912011:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d698ed89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630999168:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191899.912075:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191899.912105:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630999168
00000100:00100000:3.0:1776191899.912223:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1794
00000100:00100000:3.0:1776191899.912256:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000016dc0009 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630999552:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191899.912286:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191899.912321:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f7ba46c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467630998912:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191899.912356:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3560
00000100:00100000:3.0:1776191899.912361:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007756d7ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630999168:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191899.912397:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007756d7ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467630999168:12345-0@lo:400:kworker/u8:4.0 Request processed in 35us (322us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191899.912403:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3560
00000100:00100000:3.0:1776191899.912440:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d698ed89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467630999168:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191899.912690:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630999552
00000100:00100000:1.0:1776191899.912734:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5241
00000100:00100000:1.0:1776191899.912738:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cbd36cc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630999552:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191899.912781:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cbd36cc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467630999552:12345-0@lo:400:kworker/u8:4.0 Request processed in 43us (496us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191899.912786:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5241
00000100:00100000:3.0:1776191899.913826:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000016dc0009 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467630999552:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191899.914304:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191899.914338:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000819bd127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630999424:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191899.914362:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191899.914770:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630999360
00000100:00100000:1.0:1776191899.914892:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630999424
00000100:00100000:2.0:1776191899.915220:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602
00000100:00100000:2.0:1776191899.915226:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000057916d34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630999360:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191899.915327:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191899.915380:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000057916d34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630999360:12345-0@lo:8:kworker/u8:4.0 Request processed in 153us (1078us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191899.915387:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602
00000100:00100000:2.0:1776191899.915404:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2603
00000100:00100000:2.0:1776191899.915407:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a5f06cb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630999424:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191899.915486:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191899.915508:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a5f06cb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467630999424:12345-0@lo:8:kworker/u8:4.0 Request processed in 101us (1147us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191899.915513:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2603
00000100:00080000:0.0:1776191899.916007:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191899.916013:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191899.916017:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd341e03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467630999360:0@lo:8:kworker/u8:4.0
00000100:00080000:0.0:1776191899.916027:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191899.916030:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191899.916050:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000819bd127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467630999424:0@lo:8:kworker/u8:4.0
00010000:00010000:0.0:1776191900.667816:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191901.531692:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191901.531758:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191901.531803:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191901.531842:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191901.531868:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191901.531990:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613829376
00000100:00100000:1.0:1776191901.532102:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613829312
00000100:00100000:1.0:1776191901.532139:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2240
00000100:00100000:1.0:1776191901.532147:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b044802b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613829312:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191901.532242:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b044802b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613829312:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 95us (373us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191901.532250:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2240
00000100:00100000:1.0:1776191901.532269:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2604
00000100:00100000:1.0:1776191901.532273:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016dc0009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613829376:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:1.0:1776191901.532379:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191901.532407:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016dc0009 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613829376:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 133us (730us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191901.532418:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2604
00000100:00100000:1.0:1776191901.532561:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613829248
00000100:00100000:1.0:1776191901.532590:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613829184
00000100:00100000:1.0:1776191901.532607:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5242
00000100:00100000:1.0:1776191901.532611:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a8e91aa5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613829248:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191901.532645:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a8e91aa5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613829248:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 33us (848us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191901.532651:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5242
00000100:00100000:1.0:1776191901.532663:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5243
00000100:00100000:1.0:1776191901.532667:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019dcd236 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613829184:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191901.532689:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019dcd236 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613829184:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 21us (847us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191901.532694:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5243
00000100:00100000:0.0:1776191901.532805:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613829120
00000100:00100000:0.0:1776191901.532843:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1945
00000100:00100000:0.0:1776191901.532848:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000961e9bab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613829120:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191901.532878:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000961e9bab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613829120:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 30us (1121us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191901.532884:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1945
00010000:00010000:3.0:1776191901.693269:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191902.721832:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191902.970808:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000481c290f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630999616:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191902.971972:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191902.972494:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630999616
00000100:00100000:1.0:1776191902.972563:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3561
00000100:00100000:1.0:1776191902.972571:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f784fad4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630999616:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191902.972618:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191902.972703:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f784fad4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467630999616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (738us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191902.972710:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3561
00000100:00100000:2.0:1776191902.973239:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000481c290f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467630999616:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191903.738386:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191903.997230:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004905ea34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630999680:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191903.997338:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191903.997854:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630999680
00000100:00100000:3.0:1776191903.997918:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3562
00000100:00100000:3.0:1776191903.997925:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003cf1d110 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630999680:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191903.997970:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191903.998095:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003cf1d110 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467630999680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 169us (757us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191903.998102:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3562
00000100:00100000:2.0:1776191903.998690:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004905ea34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467630999680:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191904.763917:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1776191905.018345:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191905.018354:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191905.018358:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191905.018368:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4437
00000100:00080000:2.0:1776191905.018373:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1776191905.018380:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191905.018406:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000cfc3317d x1862467631000192/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191905.018407:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004905ea34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630999744:0@lo:400:kworker/u8:4.0
00000100:00080000:2.0:1776191905.018422:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191905.018425:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191905.018427:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191905.018429:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4437
00000100:00080000:2.0:1776191905.018431:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1776191905.018434:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191905.018444:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000ea373370 x1862467631000256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191905.018485:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000096e89164 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630999936:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191905.018554:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cfc3317d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631000192:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191905.018587:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004253d689 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630999808:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191905.026102:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191905.026182:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d808a8bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467631000000:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191905.026262:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191905.026305:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000819bd127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467631000384:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191905.026331:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191905.027083:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631000384
00000100:00100000:1.0:1776191905.027156:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5244
00000100:00100000:1.0:1776191905.027164:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000badc4b3e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467631000384:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191905.027245:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000badc4b3e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467631000384:12345-0@lo:400:kworker/u8:4.0 Request processed in 82us (913us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191905.027254:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5244
00000100:00100000:1.0:1776191905.027328:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630999744
00000100:00100000:1.0:1776191905.029002:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1946
00000100:00100000:1.0:1776191905.029017:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dce6a0d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630999744:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191905.029128:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dce6a0d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467630999744:12345-0@lo:400:kworker/u8:4.0 Request processed in 113us (3039us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191905.029278:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191905.029324:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005cfbecd5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631000064:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191905.029358:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191905.029388:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bf589eef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631000448:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191905.029412:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191905.029513:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631000000
00000100:00100000:3.0:1776191905.029563:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3563
00000100:00100000:3.0:1776191905.029567:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000d666725 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467631000000:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191905.029603:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000d666725 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467631000000:12345-0@lo:400:kworker/u8:4.0 Request processed in 35us (3341us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191905.029610:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3563
00000100:00100000:3.0:1776191905.029639:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631000448
00000100:00100000:3.0:1776191905.029680:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1795
00000100:00100000:3.0:1776191905.029684:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004a22f9ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467631000448:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191905.030129:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003135b5de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630999872:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191905.030174:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191905.030198:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b5928219 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631000128:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191905.030222:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191905.030239:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d698ed89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631000512:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191905.030258:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191905.030302:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191905.030318:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea373370 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631000256:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191905.030338:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191905.030400:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631000064
00000100:00100000:0.0:1776191905.030648:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631000128
00000100:00100000:0.0:1776191905.030667:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631000192
00000100:00100000:0.0:1776191905.030770:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631000256
00000100:00100000:0.0:1776191905.030791:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2241
00000100:00100000:0.0:1776191905.030795:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e3e1154 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467631000064:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191905.030843:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e3e1154 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467631000064:12345-0@lo:400:kworker/u8:4.0 Request processed in 48us (1485us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191905.030851:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2241
00000100:00100000:0.0:1776191905.030866:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2242
00000100:00100000:0.0:1776191905.030869:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003fb0e1f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631000128:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191905.030899:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003fb0e1f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631000128:12345-0@lo:400:kworker/u8:4.0 Request processed in 29us (676us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191905.030905:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2242
00000100:00100000:0.0:1776191905.030917:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2605
00000100:00100000:0.0:1776191905.030920:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000cddb455 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467631000192:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191905.031031:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191905.031093:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000cddb455 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467631000192:12345-0@lo:8:kworker/u8:4.0 Request processed in 172us (791us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191905.031099:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2605
00000100:00100000:0.0:1776191905.031109:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2606
00000100:00100000:0.0:1776191905.031112:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d1ba4a82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467631000256:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191905.031195:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191905.031216:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d1ba4a82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467631000256:12345-0@lo:8:kworker/u8:4.0 Request processed in 103us (877us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191905.031221:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2606
00000100:00100000:0.0:1776191905.031246:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630999808
00000100:00100000:0.0:1776191905.031274:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5245
00000100:00100000:0.0:1776191905.031277:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc38b04d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630999808:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191905.031308:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc38b04d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467630999808:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (2033us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191905.031314:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5245
00000100:00100000:0.0:1776191905.031360:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b5928219 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631000128:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191905.031401:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000819bd127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467631000384:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191905.031617:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004905ea34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467630999744:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191905.031630:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d808a8bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467631000000:0@lo:400:kworker/u8:4.0
00000100:00080000:0.0:1776191905.031666:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191905.031671:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191905.031675:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cfc3317d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631000192:0@lo:8:kworker/u8:4.0
00000100:00080000:0.0:1776191905.031769:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191905.031773:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191905.031775:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea373370 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631000256:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191905.031826:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631000512
00000100:00100000:0.0:1776191905.031860:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1796
00000100:00100000:0.0:1776191905.031865:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c0e1db0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631000512:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191905.031891:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191905.031928:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c0e1db0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631000512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (1669us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191905.031934:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1796
00000100:00100000:0.0:1776191905.031973:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d698ed89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631000512:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191905.032063:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630999872
00000100:00100000:0.0:1776191905.032081:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3564
00000100:00100000:0.0:1776191905.032085:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000481c290f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630999872:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191905.032119:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000481c290f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467630999872:12345-0@lo:400:kworker/u8:4.0 Request processed in 34us (1946us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191905.032125:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3564
00000100:00100000:0.0:1776191905.032159:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003135b5de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467630999872:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191905.032331:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004253d689 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467630999808:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191905.032345:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005cfbecd5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631000064:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191905.033856:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1946
00002000:00000024:3.0:1776191905.033858:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191905.033969:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004a22f9ff pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467631000448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4282us (4554us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191905.033983:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1795
00000100:00100000:0.0:1776191905.034197:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bf589eef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631000448:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191905.037149:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191905.037305:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008bacde2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467631000320:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191905.037348:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191905.049966:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467630999936
00000100:00100000:0.0:1776191905.050192:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631000320
00000100:00100000:2.0:1776191905.051031:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5246
00000100:00100000:2.0:1776191905.051097:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd341e03 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630999936:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191905.051236:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd341e03 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467630999936:12345-0@lo:400:kworker/u8:4.0 Request processed in 140us (14099us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191905.051245:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5246
00000100:00100000:2.0:1776191905.051281:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5247
00000100:00100000:2.0:1776191905.051286:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006821defb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467631000320:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191905.051317:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006821defb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467631000320:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (13970us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191905.051323:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5247
00000100:00100000:3.0:1776191905.051531:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000096e89164 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467630999936:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191905.051546:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008bacde2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467631000320:0@lo:400:kworker/u8:4.0
00010000:00010000:0.0:1776191905.786834:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191906.657351:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191906.657396:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191906.658352:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191906.658387:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191906.658456:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191906.658519:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613829504
00000100:00100000:0.0:1776191906.658565:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613829568
00000100:00100000:0.0:1776191906.658584:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5248
00000100:00100000:0.0:1776191906.658590:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008ef4d77e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613829504:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191906.658667:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008ef4d77e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613829504:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 77us (1324us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191906.658675:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5248
00000100:00100000:0.0:1776191906.658692:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5249
00000100:00100000:0.0:1776191906.658696:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000421d4a36 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613829568:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191906.658718:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000421d4a36 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613829568:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 21us (332us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191906.658724:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5249
00000100:00100000:0.0:1776191906.658744:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613829440
00000100:00100000:0.0:1776191906.658770:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1947
00000100:00100000:0.0:1776191906.658774:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd42e839 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613829440:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191906.658796:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd42e839 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613829440:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 21us (448us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191906.658801:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1947
00000100:00100000:3.0:1776191906.663493:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613829632
00000100:00100000:3.0:1776191906.663580:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613829696
00000100:00100000:3.0:1776191906.663622:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2243
00000100:00100000:3.0:1776191906.663628:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000067e0c0a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613829632:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191906.663706:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000067e0c0a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613829632:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 77us (6310us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191906.663715:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2243
00000100:00100000:3.0:1776191906.663737:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2607
00000100:00100000:3.0:1776191906.663742:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005f9ce4ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613829696:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:3.0:1776191906.663848:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191906.663874:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005f9ce4ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613829696:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 131us (5417us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191906.663880:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2607
00010000:00010000:0.0:1776191906.810476:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191907.835824:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191908.092298:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1776191908.092441:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ea373370 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631000576:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191908.092506:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191908.092609:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631000576
00000100:00100000:0.0:1776191908.092974:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3565
00000100:00100000:0.0:1776191908.092981:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003c5d30dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631000576:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191908.093017:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191908.094395:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ea373370 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631000576:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1776191908.094503:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003c5d30dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631000576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1520us (1996us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191908.094513:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3565
00010000:00010000:0.0:1776191908.858257:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191909.114678:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191909.114705:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000819bd127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631000640:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191909.114801:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191909.115098:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631000640
00000100:00100000:2.0:1776191909.115195:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3566
00000100:00100000:2.0:1776191909.115215:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ea373370 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467631000640:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191909.115268:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191909.115348:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ea373370 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467631000640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (547us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191909.115370:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3566
00000100:00100000:3.0:1776191909.115500:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000819bd127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631000640:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191909.882443:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1776191910.139590:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191910.139596:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191910.139599:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191910.139606:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4443
00000100:00080000:0.0:1776191910.139610:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1776191910.139615:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191910.139636:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000b5928219 x1862467631001152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191910.139653:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191910.139656:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191910.139657:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191910.139659:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4443
00000100:00080000:0.0:1776191910.139661:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1776191910.139664:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191910.139678:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000000150035b x1862467631001216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191910.139729:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005cfbecd5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631000832:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191910.139798:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191910.139849:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004905ea34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467631001088:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191910.139883:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191910.139907:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:0.0:1776191910.139912:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000096e89164 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467631000768:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191910.139964:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191910.139979:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d808a8bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631001024:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191910.139999:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191910.140024:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b5928219 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631001152:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191910.140067:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191910.140079:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000150035b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631001216:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191910.140098:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191910.140131:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631001088
00000100:00100000:0.0:1776191910.140183:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631001024
00000100:00100000:0.0:1776191910.140201:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631001152
00000100:00100000:0.0:1776191910.140211:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631001216
00000100:00100000:0.0:1776191910.140222:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2244
00000100:00100000:0.0:1776191910.140228:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d80d649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467631001088:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191910.140276:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d80d649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467631001088:12345-0@lo:400:kworker/u8:2.0 Request processed in 48us (393us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191910.140282:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2244
00000100:00100000:0.0:1776191910.140298:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2245
00000100:00100000:0.0:1776191910.140301:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d1c8a441 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467631001024:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191910.140325:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d1c8a441 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467631001024:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (326us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191910.140334:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2245
00000100:00100000:0.0:1776191910.140343:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2608
00000100:00100000:0.0:1776191910.140346:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba9731d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467631001152:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191910.140438:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191910.140468:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba9731d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467631001152:12345-0@lo:8:kworker/u8:2.0 Request processed in 120us (401us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191910.140474:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2608
00000100:00100000:0.0:1776191910.140484:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2609
00000100:00100000:0.0:1776191910.140487:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004a57869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467631001216:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191910.140573:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191910.140596:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004a57869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467631001216:12345-0@lo:8:kworker/u8:2.0 Request processed in 107us (497us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191910.140601:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2609
00000100:00080000:0.0:1776191910.140639:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191910.140643:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191910.140647:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b5928219 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631001152:0@lo:8:kworker/u8:2.0
00000100:00080000:0.0:1776191910.140655:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191910.140658:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191910.140660:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000150035b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631001216:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191910.140695:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d808a8bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631001024:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191910.140705:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004905ea34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467631001088:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191910.140799:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cfc3317d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467631000704:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191910.140832:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191910.140863:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003135b5de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631000960:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191910.140885:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191910.140900:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000f04c7a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467631001344:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191910.140921:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191910.140939:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:2.0:1776191910.140944:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004253d689 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467631000896:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191910.140964:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191910.140978:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000070835139 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467631001280:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191910.140997:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191910.141025:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631000768
00000100:00100000:2.0:1776191910.141073:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631001344
00000100:00100000:2.0:1776191910.141091:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631000896
00000100:00100000:2.0:1776191910.141104:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631001280
00000100:00100000:2.0:1776191910.141115:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5250
00000100:00100000:2.0:1776191910.141118:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000365abfb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467631000768:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191910.141157:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000365abfb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467631000768:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (1193us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191910.141163:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5250
00000100:00100000:2.0:1776191910.141176:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5251
00000100:00100000:2.0:1776191910.141179:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a0c5ca5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467631001344:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191910.141207:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a0c5ca5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467631001344:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (286us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191910.141213:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5251
00000100:00100000:2.0:1776191910.141229:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5252
00000100:00100000:2.0:1776191910.141232:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008831914d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467631000896:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191910.141257:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008831914d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467631000896:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (293us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191910.141262:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5252
00000100:00100000:2.0:1776191910.141272:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5253
00000100:00100000:2.0:1776191910.141275:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005f28ffee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467631001280:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191910.141299:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005f28ffee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467631001280:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (302us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191910.141304:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5253
00000100:00100000:2.0:1776191910.141338:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631000832
00000100:00100000:2.0:1776191910.141356:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631000960
00000100:00100000:2.0:1776191910.141368:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3567
00000100:00100000:2.0:1776191910.141371:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7098b67 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467631000832:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191910.141420:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7098b67 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467631000832:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (1624us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191910.141426:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3567
00000100:00100000:2.0:1776191910.141436:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3568
00000100:00100000:2.0:1776191910.141439:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000819bd127 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631000960:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191910.141459:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000819bd127 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631000960:12345-0@lo:400:kworker/u8:2.0 Request processed in 19us (574us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191910.141464:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3568
00000100:00100000:2.0:1776191910.141488:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004253d689 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467631000896:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191910.141498:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000070835139 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467631001280:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191910.141506:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003135b5de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631000960:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191910.141513:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000f04c7a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467631001344:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191910.141542:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000096e89164 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467631000768:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191910.141550:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005cfbecd5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631000832:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191910.141919:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a64218bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631001408:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191910.141956:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191910.141993:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631001408
00000100:00100000:1.0:1776191910.142020:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1797
00000100:00100000:1.0:1776191910.142024:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bf589eef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467631001408:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191910.142064:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191910.142097:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bf589eef pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467631001408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (141us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191910.142102:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1797
00000100:00100000:1.0:1776191910.142133:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a64218bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631001408:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191910.142667:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aaefa947 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467631001472:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191910.142697:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191910.143443:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631000704
00000100:00100000:0.0:1776191910.143499:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1948
00000100:00100000:0.0:1776191910.143504:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002224990e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467631000704:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191910.143561:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002224990e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467631000704:12345-0@lo:400:kworker/u8:2.0 Request processed in 56us (2729us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191910.143568:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1948
00000100:00100000:0.0:1776191910.143610:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cfc3317d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467631000704:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191910.143765:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631001472
00000100:00100000:1.0:1776191910.143799:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1798
00000100:00100000:1.0:1776191910.143802:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000f04c7a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467631001472:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191910.143816:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191910.150905:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000f04c7a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467631001472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7092us (8198us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191910.150920:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1798
00000100:00100000:2.0:1776191910.153715:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aaefa947 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467631001472:0@lo:13:osp-pre-0-0.0
00010000:00010000:3.0:1776191910.906965:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191911.772775:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191911.772838:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191911.772875:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191911.772923:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191911.772990:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191911.773025:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613830016
00000100:00100000:1.0:1776191911.773094:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613829952
00000100:00100000:1.0:1776191911.773135:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2246
00000100:00100000:1.0:1776191911.773141:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009af94ad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613829952:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191911.773533:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009af94ad9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613829952:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 391us (543us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191911.773542:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2246
00000100:00100000:1.0:1776191911.773560:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2610
00000100:00100000:1.0:1776191911.773564:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004250bccf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613830016:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:1.0:1776191911.773657:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191911.773683:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004250bccf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613830016:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 117us (760us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191911.773689:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2610
00000100:00100000:0.0:1776191911.774094:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613829760
00000100:00100000:0.0:1776191911.774140:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1949
00000100:00100000:0.0:1776191911.774145:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e89cfd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613829760:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191911.774182:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e89cfd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613829760:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 36us (1344us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191911.774188:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1949
00000100:00100000:2.0:1776191911.774701:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613829824
00000100:00100000:2.0:1776191911.774740:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613829888
00000100:00100000:2.0:1776191911.774767:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5254
00000100:00100000:2.0:1776191911.774771:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a64218bc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613829824:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191911.774825:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a64218bc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613829824:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 53us (2059us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191911.774832:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5254
00000100:00100000:2.0:1776191911.774846:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5255
00000100:00100000:2.0:1776191911.774851:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f7ba46c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613829888:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191911.774873:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f7ba46c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613829888:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 22us (1999us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191911.774878:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5255
00010000:00010000:0.0:1776191911.933293:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191912.954426:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191913.210852:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776191913.210876:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cfc3317d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631001536:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191913.210948:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191913.211060:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631001536
00000100:00100000:0.0:1776191913.211115:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3569
00000100:00100000:0.0:1776191913.211121:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a133ee9d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631001536:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191913.211155:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191913.211208:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a133ee9d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631001536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (260us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191913.211215:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3569
00000100:00100000:1.0:1776191913.211295:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cfc3317d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631001536:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191913.978232:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191914.234925:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1776191914.234940:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8ca4c1a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467631001600:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191914.235007:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191914.235179:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631001600
00000100:00100000:0.0:1776191914.235250:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3570
00000100:00100000:0.0:1776191914.235256:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be2f7060 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467631001600:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191914.235290:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191914.235343:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be2f7060 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467631001600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (337us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191914.235351:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3570
00000100:00100000:2.0:1776191914.238995:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8ca4c1a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467631001600:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191915.002463:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191915.258244:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000023fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631001728:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1776191915.258265:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191915.258270:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191915.258274:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191915.258279:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4448
00000100:00080000:0.0:1776191915.258282:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1776191915.258288:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191915.258309:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000070835139 x1862467631002176/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191915.258324:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1776191915.258327:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1776191915.258329:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191915.258332:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191915.258336:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4448
00000100:00080000:0.0:1776191915.258338:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1776191915.258341:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191915.258352:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000000150035b x1862467631002240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191915.258372:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000096e89164 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467631001920:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191915.258394:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000070835139 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631002176:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191915.258402:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191915.258420:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b5928219 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467631002304:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191915.258432:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191915.258449:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000150035b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631002240:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191915.258468:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191915.258506:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005cfbecd5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631001856:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191915.258535:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191915.258554:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d808a8bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631002112:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191915.258571:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191915.258582:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191915.258597:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [1->0]
00000100:00100000:1.0:1776191915.258605:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cfc3317d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467631001664:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191915.258633:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191915.258649:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003135b5de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631001984:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191915.258671:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191915.258683:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ee2fc84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467631002368:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191915.258702:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191915.258748:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631001920
00000100:00100000:1.0:1776191915.258789:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631002304
00000100:00100000:1.0:1776191915.258803:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631002368
00000100:00100000:1.0:1776191915.258821:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5256
00000100:00100000:1.0:1776191915.258827:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007759fe0d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467631001920:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191915.258888:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631001856
00000100:00100000:1.0:1776191915.258901:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007759fe0d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467631001920:12345-0@lo:400:kworker/u8:2.0 Request processed in 72us (498us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191915.258910:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5256
00000100:00100000:3.0:1776191915.258912:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631001984
00000100:00100000:3.0:1776191915.258929:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3571
00000100:00100000:1.0:1776191915.258934:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5257
00000100:00100000:3.0:1776191915.258935:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d2e07ba pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467631001856:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191915.258942:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000013d8b4cd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467631002304:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191915.258974:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000013d8b4cd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467631002304:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (404us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191915.258980:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5257
00000100:00100000:3.0:1776191915.258990:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d2e07ba pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467631001856:12345-0@lo:400:kworker/u8:2.0 Request processed in 54us (456us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191915.258997:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5258
00000100:00100000:3.0:1776191915.259000:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3571
00000100:00100000:1.0:1776191915.259003:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f107848 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467631002368:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191915.259020:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3572
00000100:00100000:3.0:1776191915.259025:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c251e98f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631001984:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191915.259055:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f107848 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467631002368:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (331us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191915.259062:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5258
00000100:00100000:1.0:1776191915.259084:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631002176
00000100:00100000:3.0:1776191915.259088:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c251e98f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631001984:12345-0@lo:400:kworker/u8:2.0 Request processed in 61us (416us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191915.259094:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3572
00000100:00100000:1.0:1776191915.259101:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631002240
00000100:00100000:1.0:1776191915.259119:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631002112
00000100:00100000:1.0:1776191915.259147:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2247
00000100:00100000:3.0:1776191915.259147:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631001664
00000100:00100000:1.0:1776191915.259154:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000746b7981 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631002112:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191915.259176:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1950
00000100:00100000:1.0:1776191915.259187:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000746b7981 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631002112:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (605us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191915.259194:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2247
00000100:00100000:3.0:1776191915.259198:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f3625dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467631001664:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191915.259210:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2611
00000100:00100000:1.0:1776191915.259214:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e63aab7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467631002176:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191915.259232:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f3625dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467631001664:12345-0@lo:400:kworker/u8:2.0 Request processed in 49us (597us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191915.259238:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1950
00000100:00100000:3.0:1776191915.259269:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2612
00000100:00100000:3.0:1776191915.259272:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002986576f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467631002240:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191915.259355:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191915.259386:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002986576f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467631002240:12345-0@lo:8:kworker/u8:2.0 Request processed in 112us (918us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191915.259392:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2612
00010000:02020000:1.0:1776191915.259407:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191915.259414:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631001728
00000100:00100000:3.0:1776191915.259439:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1799
00000100:00100000:3.0:1776191915.259444:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fca68564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467631001728:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191915.259463:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191915.259503:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e63aab7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467631002176:12345-0@lo:8:kworker/u8:2.0 Request processed in 286us (1070us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191915.259506:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fca68564 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467631001728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (1180us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191915.259514:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2611
00000100:00100000:3.0:1776191915.259518:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1799
00000100:00100000:1.0:1776191915.259569:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cfc3317d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467631001664:0@lo:400:kworker/u8:2.0
00000100:00080000:3.0:1776191915.259581:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191915.259585:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191915.259586:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003135b5de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631001984:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191915.259591:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000070835139 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631002176:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191915.259599:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ee2fc84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467631002368:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191915.259611:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000096e89164 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467631001920:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191915.259619:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b5928219 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467631002304:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191915.259633:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000023fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631001728:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1776191915.259959:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191915.259963:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191915.259966:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000150035b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631002240:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191915.260162:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005cfbecd5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631001856:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191915.260173:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d808a8bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631002112:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191915.260195:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:0.0:1776191915.260203:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004905ea34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467631001792:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191915.260235:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191915.260261:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004253d689 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631002048:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191915.260282:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191915.260418:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631001792
00000100:00100000:3.0:1776191915.260455:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5259
00000100:00100000:3.0:1776191915.260461:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ee2fc84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467631001792:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191915.260498:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ee2fc84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467631001792:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (263us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191915.260506:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5259
00000100:00100000:2.0:1776191915.260627:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631002048
00000100:00100000:2.0:1776191915.260658:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2248
00000100:00100000:2.0:1776191915.260661:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000128cb0b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467631002048:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191915.260692:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000128cb0b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467631002048:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (410us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191915.260698:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2248
00000100:00100000:0.0:1776191915.260985:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004905ea34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467631001792:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191915.260994:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004253d689 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631002048:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191915.261006:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191915.261011:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000090a5e0f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631002432:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191915.261053:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191915.269907:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631002432
00000100:00100000:3.0:1776191915.269970:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1800
00000100:00100000:3.0:1776191915.269976:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004905ea34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631002432:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191915.270001:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191915.270356:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004905ea34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631002432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 378us (9302us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191915.270363:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1800
00000100:00100000:2.0:1776191915.270811:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000090a5e0f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631002432:0@lo:13:osp-pre-0-0.0
00010000:00010000:0.0:1776191916.038314:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191916.892893:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191916.892959:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191916.892997:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191916.893030:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191916.893102:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191916.893134:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613830080
00000100:00100000:2.0:1776191916.893183:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1951
00000100:00100000:2.0:1776191916.893190:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e270043d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613830080:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191916.893249:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e270043d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613830080:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 59us (219us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191916.893255:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1951
00000100:00100000:2.0:1776191916.893283:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613830144
00000100:00100000:2.0:1776191916.893304:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613830208
00000100:00100000:2.0:1776191916.893317:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5260
00000100:00100000:2.0:1776191916.893321:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dfa2450e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613830144:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191916.893347:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dfa2450e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613830144:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 25us (389us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191916.893353:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5260
00000100:00100000:2.0:1776191916.893364:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5261
00000100:00100000:2.0:1776191916.893367:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af1b2795 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613830208:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191916.893383:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af1b2795 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613830208:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 16us (282us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191916.893389:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5261
00000100:00100000:3.0:1776191916.893711:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613830336
00000100:00100000:3.0:1776191916.893739:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613830272
00000100:00100000:3.0:1776191916.893767:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2249
00000100:00100000:3.0:1776191916.893771:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f0419e09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613830272:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191916.893798:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f0419e09 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613830272:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 26us (801us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191916.893803:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2249
00000100:00100000:3.0:1776191916.893815:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2613
00000100:00100000:3.0:1776191916.893818:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b8ca4c1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613830336:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:3.0:1776191916.893916:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191916.893942:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b8ca4c1a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613830336:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 123us (1058us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191916.893947:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2613
00010000:00010000:3.0:1776191917.050417:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191918.074355:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191918.331929:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1776191918.331943:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b044802b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467631002496:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191918.332008:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191918.332117:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631002496
00000100:00100000:0.0:1776191918.332164:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3573
00000100:00100000:0.0:1776191918.332169:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ca4bb8b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467631002496:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191918.332209:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191918.332262:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ca4bb8b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467631002496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (254us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191918.332268:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3573
00000100:00100000:1.0:1776191918.332840:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b044802b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467631002496:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191919.101632:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191919.354465:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071dfa1cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631002560:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191919.354535:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191919.354993:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631002560
00000100:00100000:0.0:1776191919.355056:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3574
00000100:00100000:0.0:1776191919.355062:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc2a3d25 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467631002560:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191919.355101:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191919.356224:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc2a3d25 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467631002560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1157us (1686us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191919.356235:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3574
00000100:00100000:2.0:1776191919.356309:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071dfa1cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631002560:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191920.126198:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191920.378360:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776191920.378375:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004f9388e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631002624:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191920.378441:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191920.378530:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631002624
00000100:00100000:1.0:1776191920.378584:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1801
00000100:00100000:1.0:1776191920.378590:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001672005a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467631002624:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191920.378630:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191920.378672:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001672005a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467631002624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (231us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191920.378679:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1801
00000100:00100000:2.0:1776191920.378766:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004f9388e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631002624:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1776191920.379154:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191920.379158:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191920.379161:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191920.379165:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4453
00000100:00080000:2.0:1776191920.379168:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1776191920.379172:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191920.379187:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000083bd922b x1862467631003072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191920.379200:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191920.379203:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191920.379204:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191920.379206:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4453
00000100:00080000:2.0:1776191920.379208:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1776191920.379222:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191920.379232:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000c1d8acf1 x1862467631003136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191920.379264:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd4d6b50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467631002752:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191920.379293:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191920.379307:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac03ecb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631003008:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191920.379338:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191920.379354:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:2.0:1776191920.379358:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009e3074ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467631002688:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191920.379383:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191920.379393:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002cd60e9a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631002944:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191920.379413:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191920.379441:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631003008
00000100:00100000:2.0:1776191920.379468:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2250
00000100:00100000:2.0:1776191920.379471:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006467642c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631003008:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191920.379507:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006467642c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631003008:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (169us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191920.379513:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2250
00000100:00100000:2.0:1776191920.379537:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac03ecb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631003008:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191920.379552:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a2271622 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631002816:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191920.379570:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191920.379580:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b538d61e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467631003200:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191920.379595:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191920.379607:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:2.0:1776191920.379611:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e9f716d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467631002880:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191920.379645:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191920.379657:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000546b9ee0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467631003264:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191920.379673:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191920.379692:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631002752
00000100:00100000:2.0:1776191920.379712:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631003200
00000100:00100000:2.0:1776191920.379725:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631002880
00000100:00100000:2.0:1776191920.379737:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631003264
00000100:00100000:2.0:1776191920.379747:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5262
00000100:00100000:2.0:1776191920.379751:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f4067d18 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467631002752:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191920.379782:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f4067d18 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467631002752:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (489us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191920.379788:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5262
00000100:00100000:2.0:1776191920.379799:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5263
00000100:00100000:2.0:1776191920.379803:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e267ab82 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467631003200:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191920.379830:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e267ab82 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467631003200:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (234us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191920.379835:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5263
00000100:00100000:2.0:1776191920.379845:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5264
00000100:00100000:2.0:1776191920.379848:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000afcb0be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467631002880:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191920.379871:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000afcb0be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467631002880:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (227us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191920.379876:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5264
00000100:00100000:2.0:1776191920.379885:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5265
00000100:00100000:2.0:1776191920.379888:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fc9b094a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467631003264:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191920.379909:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fc9b094a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467631003264:12345-0@lo:400:kworker/u8:2.0 Request processed in 21us (236us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191920.379915:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5265
00000100:00100000:2.0:1776191920.379948:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd4d6b50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467631002752:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191920.379967:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e9f716d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467631002880:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191920.379974:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000546b9ee0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467631003264:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191920.379980:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b538d61e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467631003200:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191920.380128:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631002944
00000100:00100000:1.0:1776191920.380147:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631002816
00000100:00100000:1.0:1776191920.380158:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3575
00000100:00100000:1.0:1776191920.380162:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d7d52e7c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631002944:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191920.380204:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d7d52e7c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631002944:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (790us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191920.380209:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3575
00000100:00100000:1.0:1776191920.380221:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3576
00000100:00100000:1.0:1776191920.380224:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ac03ecb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467631002816:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191920.380254:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ac03ecb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467631002816:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (683us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191920.380260:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3576
00000100:00100000:1.0:1776191920.380289:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a2271622 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631002816:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191920.380522:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000083bd922b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631003072:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191920.380549:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191920.380569:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c1d8acf1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631003136:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191920.380586:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191920.380610:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631002688
00000100:00100000:3.0:1776191920.380649:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1952
00000100:00100000:3.0:1776191920.380653:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fecbd6f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467631002688:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191920.380677:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fecbd6f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467631002688:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (1295us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191920.380683:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1952
00000100:00100000:3.0:1776191920.380711:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631003072
00000100:00100000:3.0:1776191920.380723:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631003136
00000100:00100000:3.0:1776191920.380734:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2614
00000100:00100000:3.0:1776191920.380737:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003cd04cf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467631003072:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191920.380839:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191920.380866:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003cd04cf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467631003072:12345-0@lo:8:kworker/u8:2.0 Request processed in 129us (318us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191920.380871:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2614
00000100:00100000:3.0:1776191920.380880:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2615
00000100:00100000:3.0:1776191920.380883:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cf4f5e1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467631003136:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191920.380961:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191920.380978:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cf4f5e1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467631003136:12345-0@lo:8:kworker/u8:2.0 Request processed in 95us (392us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191920.380983:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2615
00000100:00080000:3.0:1776191920.381007:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191920.381010:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191920.381013:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000083bd922b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631003072:0@lo:8:kworker/u8:2.0
00000100:00080000:3.0:1776191920.381020:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191920.381022:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191920.381024:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c1d8acf1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631003136:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191920.381822:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cd00ffe3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467631003328:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191920.381861:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191920.382153:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009e3074ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467631002688:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191920.382166:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002cd60e9a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631002944:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191920.388152:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631003328
00000100:00100000:3.0:1776191920.388241:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1802
00000100:00100000:3.0:1776191920.388248:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b044802b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467631003328:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191920.388274:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191920.388368:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b044802b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467631003328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (6506us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191920.388376:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1802
00000100:00100000:0.0:1776191920.388645:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cd00ffe3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467631003328:0@lo:13:osp-pre-0-0.0
00010000:00010000:0.0:1776191921.147934:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191922.014014:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191922.014089:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191922.014124:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191922.014158:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191922.014187:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191922.014233:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613830528
00000100:00100000:1.0:1776191922.014460:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613830464
00000100:00100000:1.0:1776191922.014502:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5266
00000100:00100000:1.0:1776191922.014509:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b538d61e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613830464:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191922.014581:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b538d61e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613830464:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 71us (422us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191922.014604:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5266
00000100:00100000:1.0:1776191922.014635:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613830656
00000100:00100000:1.0:1776191922.014649:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613830592
00000100:00100000:1.0:1776191922.014666:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2251
00000100:00100000:1.0:1776191922.014670:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000546b9ee0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613830592:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191922.014695:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000546b9ee0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613830592:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 23us (508us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191922.014700:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2251
00000100:00100000:1.0:1776191922.014711:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2616
00000100:00100000:1.0:1776191922.014714:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002cd60e9a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613830656:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:1.0:1776191922.014823:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191922.014848:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002cd60e9a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613830656:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 132us (760us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191922.014854:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2616
00000100:00100000:3.0:1776191922.015167:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613830400
00000100:00100000:3.0:1776191922.015205:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1953
00000100:00100000:3.0:1776191922.015209:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f7ed2aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613830400:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191922.015252:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f7ed2aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613830400:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 42us (1245us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191922.015269:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1953
00000100:00100000:2.0:1776191922.015571:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5267
00000100:00100000:2.0:1776191922.015576:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009e3074ed pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613830528:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191922.015621:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009e3074ed pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613830528:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 45us (1498us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191922.015628:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5267
00010000:00010000:0.0:1776191922.171494:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191923.194265:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191923.455003:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631003392:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191923.455094:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191923.455178:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631003392
00000100:00100000:3.0:1776191923.455212:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3577
00000100:00100000:3.0:1776191923.455217:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e9f716d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631003392:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191923.455245:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191923.470411:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e9f716d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631003392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 15176us (15300us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191923.470525:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3577
00000100:00100000:2.0:1776191923.470934:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631003392:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191924.220598:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191924.477886:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cebeb50f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631003456:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191924.477972:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191924.478096:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631003456
00000100:00100000:3.0:1776191924.478148:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3578
00000100:00100000:3.0:1776191924.478155:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1fe5010 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467631003456:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191924.478190:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191924.478257:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1fe5010 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467631003456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (286us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191924.478265:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3578
00000100:00100000:2.0:1776191924.478398:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cebeb50f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631003456:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191925.242607:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1776191925.499555:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191925.499564:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191925.499567:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191925.499575:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4458
00000100:00080000:2.0:1776191925.499578:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1776191925.499583:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191925.499605:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000c1d8acf1 x1862467631003968/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191925.499620:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191925.499623:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191925.499624:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191925.499627:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4458
00000100:00080000:2.0:1776191925.499628:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1776191925.499631:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191925.499640:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000083bd922b x1862467631004032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:2.0:1776191925.499690:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f53454d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467631003584:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191925.499747:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191925.499771:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a7facb6d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467631003840:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191925.499790:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191925.499911:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c1d8acf1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631003968:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191925.499968:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5f3bab2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467631003712:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191925.499989:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191925.500006:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a2271622 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467631004096:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191925.500024:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191925.500058:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [1->0]
00000100:00100000:3.0:1776191925.500063:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd4d6b50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467631003520:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191925.500088:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191925.500102:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000373be12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631003776:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191925.500121:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191925.500134:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008bacde2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467631004160:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191925.500152:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191925.500194:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631003584
00000100:00100000:3.0:1776191925.500242:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631003712
00000100:00100000:3.0:1776191925.500256:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631004096
00000100:00100000:3.0:1776191925.500269:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631004160
00000100:00100000:3.0:1776191925.500281:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5268
00000100:00100000:3.0:1776191925.500286:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e964c59 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467631003584:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191925.500326:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e964c59 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467631003584:12345-0@lo:400:kworker/u8:4.0 Request processed in 38us (579us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191925.500332:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5268
00000100:00100000:3.0:1776191925.500344:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5269
00000100:00100000:3.0:1776191925.500347:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007e2b3438 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467631003712:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191925.500369:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007e2b3438 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467631003712:12345-0@lo:400:kworker/u8:4.0 Request processed in 21us (379us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191925.500376:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5269
00000100:00100000:3.0:1776191925.500384:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5270
00000100:00100000:3.0:1776191925.500387:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f61127c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467631004096:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191925.500409:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f61127c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467631004096:12345-0@lo:400:kworker/u8:4.0 Request processed in 20us (384us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191925.500414:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5270
00000100:00100000:3.0:1776191925.500424:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5271
00000100:00100000:3.0:1776191925.500427:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cebeb50f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467631004160:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191925.500449:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cebeb50f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467631004160:12345-0@lo:400:kworker/u8:4.0 Request processed in 20us (297us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191925.500453:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5271
00000100:00100000:3.0:1776191925.500470:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631003520
00000100:00100000:3.0:1776191925.500490:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1954
00000100:00100000:3.0:1776191925.500493:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000328cc67f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467631003520:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191925.500530:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000328cc67f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467631003520:12345-0@lo:400:kworker/u8:4.0 Request processed in 36us (442us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191925.500537:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1954
00000100:00100000:3.0:1776191925.500561:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631003776
00000100:00100000:3.0:1776191925.500583:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3579
00000100:00100000:3.0:1776191925.500586:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000017340e28 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631003776:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191925.500624:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000017340e28 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631003776:12345-0@lo:400:kworker/u8:4.0 Request processed in 36us (502us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191925.500631:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3579
00000100:00100000:1.0:1776191925.500680:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000050a59c5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631003648:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191925.500709:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191925.500927:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631003840
00000100:00100000:0.0:1776191925.500953:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2252
00000100:00100000:0.0:1776191925.500958:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000780602c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467631003840:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191925.513379:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd4d6b50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467631003520:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191925.513420:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631003648
00000100:00100000:3.0:1776191925.513479:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3580
00000100:00100000:3.0:1776191925.513518:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f9388e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467631003648:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191925.513551:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000780602c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467631003840:12345-0@lo:400:kworker/u8:4.0 Request processed in 12591us (13759us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191925.513561:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2252
00000100:00100000:3.0:1776191925.513583:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f9388e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467631003648:12345-0@lo:400:kworker/u8:4.0 Request processed in 95us (12871us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191925.513590:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3580
00000100:00100000:0.0:1776191925.513632:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191925.513638:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000373be12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631003776:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191925.513656:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631003968
00000100:00100000:0.0:1776191925.513667:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000083bd922b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631004032:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191925.513679:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2617
00000100:00100000:3.0:1776191925.513684:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000150035b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467631003968:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191925.513702:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191925.513735:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631004032
00010000:02020000:3.0:1776191925.513788:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191925.513821:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000150035b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467631003968:12345-0@lo:8:kworker/u8:4.0 Request processed in 136us (190us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191925.513826:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2617
00000100:00100000:3.0:1776191925.513836:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2618
00000100:00100000:3.0:1776191925.513838:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070835139 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467631004032:12345-0@lo:8:kworker/u8:4.0
00000100:00080000:0.0:1776191925.513916:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191925.513921:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191925.513926:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c1d8acf1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631003968:0@lo:8:kworker/u8:4.0
00010000:02020000:3.0:1776191925.513931:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191925.513967:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070835139 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467631004032:12345-0@lo:8:kworker/u8:4.0 Request processed in 127us (267us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191925.513973:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2618
00000100:00100000:3.0:1776191925.514000:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008bacde2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467631004160:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191925.514011:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5f3bab2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467631003712:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191925.514021:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a2271622 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467631004096:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191925.514172:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000050a59c5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631003648:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191925.514181:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005947d33d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631003904:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191925.514203:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191925.514231:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631003904
00000100:00100000:1.0:1776191925.515557:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2253
00000100:00100000:1.0:1776191925.515565:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000023fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631003904:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191925.515629:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000023fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631003904:12345-0@lo:400:kworker/u8:4.0 Request processed in 64us (1426us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191925.515636:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2253
00000100:00080000:0.0:1776191925.515697:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191925.515701:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191925.515706:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000083bd922b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631004032:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191925.515739:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631004288:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191925.515769:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191925.515802:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005947d33d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631003904:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191925.515813:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191925.515818:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000acbe1ca8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631004224:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191925.515838:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191925.515863:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631004288
00000100:00100000:0.0:1776191925.515888:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631004224
00000100:00100000:0.0:1776191925.515900:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1803
00000100:00100000:0.0:1776191925.515904:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000083bd922b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631004288:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191925.515924:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191925.515951:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000083bd922b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631004288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (182us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191925.515956:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1803
00000100:00100000:0.0:1776191925.515966:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1804
00000100:00100000:0.0:1776191925.515969:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005947d33d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467631004224:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191925.515976:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191925.515994:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005947d33d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467631004224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 24us (156us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191925.515999:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1804
00000100:00100000:0.0:1776191925.516030:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631004288:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191925.516061:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000acbe1ca8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631004224:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191925.520024:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a7facb6d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467631003840:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191925.520083:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f53454d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467631003584:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191926.266595:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191927.142299:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191927.142357:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191927.142389:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191927.142406:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613830720
00000100:00100000:1.0:1776191927.142439:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191927.142454:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1955
00000100:00100000:3.0:1776191927.142461:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019aa1469 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613830720:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191927.142469:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613830912
00000100:00100000:2.0:1776191927.142529:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613830784
00000100:00100000:1.0:1776191927.142530:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2254
00000100:00100000:1.0:1776191927.142537:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d808a8bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613830912:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191927.142550:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019aa1469 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613830720:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 89us (260us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191927.142559:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1955
00000100:00100000:2.0:1776191927.142569:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613830848
00000100:00100000:1.0:1776191927.142576:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d808a8bb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613830912:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 33us (132us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191927.142584:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2254
00000100:00100000:2.0:1776191927.142590:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5272
00000100:00100000:2.0:1776191927.142595:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b5928219 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613830784:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191927.142617:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5273
00000100:00100000:2.0:1776191927.142626:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b5928219 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613830784:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 30us (268us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191927.142693:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004253d689 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613830848:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191927.142728:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004253d689 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613830848:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 35us (339us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191927.146878:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5272
00000100:00100000:3.0:1776191927.150123:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191927.150223:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613830976
00000100:00100000:2.0:1776191927.150271:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2619
00000100:00100000:2.0:1776191927.150278:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd00ffe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613830976:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:2.0:1776191927.150376:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191927.150437:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd00ffe3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613830976:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 158us (322us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191927.150445:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2619
00000100:00100000:1.0:1776191927.153878:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5273
00010000:00010000:0.0:1776191927.290584:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191928.314299:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191928.570439:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000050a59c5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631004352:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191928.570514:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191928.572551:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631004352
00000100:00100000:1.0:1776191928.572624:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3581
00000100:00100000:1.0:1776191928.572630:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000071dfa1cb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631004352:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191928.572667:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191928.576586:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071dfa1cb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631004352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3946us (6063us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191928.576603:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000050a59c5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631004352:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191928.577244:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3581
00010000:00010000:3.0:1776191929.339865:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191929.594282:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000090a5e0f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631004416:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1776191929.594351:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191929.594503:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631004416
00000100:00100000:1.0:1776191929.594552:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3582
00000100:00100000:1.0:1776191929.594558:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2271622 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467631004416:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191929.594590:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191929.596668:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2271622 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467631004416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2101us (2310us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191929.596681:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3582
00000100:00100000:0.0:1776191929.599633:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000090a5e0f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631004416:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191930.362321:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191930.618217:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5f3bab2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467631004480:0@lo:13:osp-pre-0-0.0
00000100:00080000:2.0:1776191930.618269:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191930.618274:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191930.618277:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191930.618282:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4463
00000100:00100000:0.0:1776191930.618284:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1776191930.618285:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1776191930.618290:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191930.618328:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e15780a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467631004736:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191930.618352:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191930.618373:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:0.0:1776191930.618379:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000025ef566e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467631004544:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191930.618419:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191930.618435:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000296e59aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467631004800:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191930.618460:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191930.618464:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d2780f83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631004672:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191930.618494:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631004736
00000100:00100000:1.0:1776191930.618500:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191930.618523:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040075bf1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467631004928:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191930.618548:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5274
00000100:00100000:0.0:1776191930.618554:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd4d6b50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467631004736:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191930.618559:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191930.618578:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:1.0:1776191930.618584:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007670a2b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467631004608:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191930.618611:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd4d6b50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467631004736:12345-0@lo:400:kworker/u8:2.0 Request processed in 55us (257us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191930.618617:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191930.618626:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5274
00000100:00100000:1.0:1776191930.618643:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006503fab3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631004864:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191930.618645:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631004608
00000100:00100000:0.0:1776191930.618672:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5275
00000100:00100000:1.0:1776191930.618675:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191930.618680:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003135b5de pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467631004608:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191930.618705:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000d799a936 x1862467631004992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191930.618712:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631004928
00000100:00100000:0.0:1776191930.618720:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003135b5de pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467631004608:12345-0@lo:400:kworker/u8:2.0 Request processed in 41us (106us total) trans 0 rc 0/0
00000100:00080000:2.0:1776191930.618721:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191930.618725:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191930.618727:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1776191930.618728:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5275
00000100:00080000:2.0:1776191930.618731:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4463
00000100:00080000:2.0:1776191930.618733:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1776191930.618736:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191930.618743:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2255
00000100:00100000:1.0:1776191930.618748:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096e89164 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467631004928:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191930.618751:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000ebbe68e0 x1862467631005056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191930.618752:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d799a936 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631004992:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191930.618780:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191930.618794:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096e89164 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467631004928:12345-0@lo:400:kworker/u8:2.0 Request processed in 44us (246us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191930.618802:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2255
00000100:00100000:2.0:1776191930.618805:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631004800
00000100:00100000:0.0:1776191930.618819:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ebbe68e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631005056:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191930.618821:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631004864
00000100:00100000:2.0:1776191930.618832:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631004672
00000100:00100000:0.0:1776191930.618845:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191930.618854:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631004992
00000100:00100000:2.0:1776191930.618854:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3583
00000100:00100000:2.0:1776191930.618859:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c1d8acf1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467631004800:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191930.618873:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631005056
00000100:00100000:1.0:1776191930.618876:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2256
00000100:00100000:1.0:1776191930.618882:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cfc3317d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467631004864:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191930.618892:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2620
00000100:00100000:0.0:1776191930.618897:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000050a59c5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467631004992:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191930.618913:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cfc3317d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467631004864:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (243us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191930.618920:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2256
00000100:00100000:1.0:1776191930.618932:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2621
00000100:00100000:1.0:1776191930.618936:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f53454d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467631005056:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191930.619100:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191930.619132:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000050a59c5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467631004992:12345-0@lo:8:kworker/u8:2.0 Request processed in 234us (352us total) trans 0 rc -19/-19
00010000:02020000:1.0:1776191930.619140:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191930.619141:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2620
00000100:00100000:0.0:1776191930.619167:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3584
00000100:00100000:0.0:1776191930.619175:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005cfbecd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467631004672:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191930.619176:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f53454d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467631005056:12345-0@lo:8:kworker/u8:2.0 Request processed in 236us (329us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191930.619190:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2621
00000100:00100000:1.0:1776191930.619211:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000cddb455 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467631005184:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191930.619214:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005cfbecd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467631004672:12345-0@lo:400:kworker/u8:2.0 Request processed in 39us (714us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191930.619223:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3584
00000100:00080000:0.0:1776191930.619257:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191930.619260:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191930.619264:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ebbe68e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631005056:0@lo:8:kworker/u8:2.0
00000100:00080000:0.0:1776191930.619479:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191930.619483:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191930.619483:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c1d8acf1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467631004800:12345-0@lo:400:kworker/u8:2.0 Request processed in 622us (1023us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191930.619486:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d799a936 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631004992:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191930.619489:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3583
00000100:00100000:0.0:1776191930.619515:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003fb0e1f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467631005120:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191930.619533:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007670a2b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467631004608:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191930.619541:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191930.619543:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006503fab3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631004864:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191930.619551:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d2780f83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631004672:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191930.619559:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000296e59aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467631004800:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191930.619559:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040075bf1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467631004928:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191930.619568:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e15780a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467631004736:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191930.619590:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631005120
00000100:00100000:2.0:1776191930.619626:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5276
00000100:00100000:2.0:1776191930.619630:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7facb6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467631005120:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191930.619662:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7facb6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467631005120:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (120us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191930.619668:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5276
00000100:00100000:0.0:1776191930.619756:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003fb0e1f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467631005120:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191930.619886:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631004480
00000100:00100000:3.0:1776191930.619911:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1805
00000100:00100000:3.0:1776191930.619915:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000373be12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467631004480:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191930.619935:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191930.619951:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191930.619980:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000373be12 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467631004480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (1694us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191930.619986:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1805
00000100:00100000:2.0:1776191930.619994:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aaefa947 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631005248:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191930.620020:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191930.620049:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631005184
00000100:00100000:0.0:1776191930.620074:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5277
00000100:00100000:0.0:1776191930.620093:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af44226e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467631005184:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191930.620115:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631004544
00000100:00100000:0.0:1776191930.620129:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af44226e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467631005184:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (179us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191930.620135:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5277
00000100:00100000:0.0:1776191930.620164:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5f3bab2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467631004480:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191930.620194:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000cddb455 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467631005184:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191930.630947:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1956
00000100:00100000:1.0:1776191930.630960:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe981ad6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467631004544:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191930.631069:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe981ad6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467631004544:12345-0@lo:400:kworker/u8:2.0 Request processed in 110us (12650us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191930.631089:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1956
00000100:00100000:3.0:1776191930.638459:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631005248
00000100:00100000:0.0:1776191930.640653:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000025ef566e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467631004544:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191930.641124:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1806
00000100:00100000:1.0:1776191930.641132:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d1ba4a82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467631005248:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191930.641159:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191930.641242:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d1ba4a82 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467631005248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (21221us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191930.641249:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1806
00000100:00100000:3.0:1776191930.641289:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aaefa947 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631005248:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1776191931.389471:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191932.252245:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191932.252298:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191932.252384:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191932.252418:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191932.252441:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191932.252476:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613831296
00000100:00100000:3.0:1776191932.252508:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613831232
00000100:00100000:3.0:1776191932.252534:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2257
00000100:00100000:3.0:1776191932.252541:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090a5e0f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613831232:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191932.252622:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090a5e0f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613831232:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 81us (238us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191932.252630:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2257
00000100:00100000:3.0:1776191932.252647:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2622
00000100:00100000:3.0:1776191932.252650:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aaefa947 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613831296:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:3.0:1776191932.252761:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191932.252787:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aaefa947 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2262:x1862467613831296:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 136us (552us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191932.252793:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2622
00000100:00100000:0.0:1776191932.252975:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613831104
00000100:00100000:0.0:1776191932.253007:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613831168
00000100:00100000:0.0:1776191932.253028:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5278
00000100:00100000:0.0:1776191932.253062:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d698ed89 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613831104:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191932.253098:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d698ed89 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613831104:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 65us (800us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191932.253105:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5278
00000100:00100000:0.0:1776191932.253117:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5279
00000100:00100000:0.0:1776191932.253122:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000acbe1ca8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613831168:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191932.253144:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000acbe1ca8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613831168:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 22us (702us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191932.253149:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5279
00000100:00100000:1.0:1776191932.253657:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613831040
00000100:00100000:1.0:1776191932.253706:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1957
00000100:00100000:1.0:1776191932.253711:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001479089e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613831040:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191932.253755:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001479089e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613831040:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 44us (1337us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191932.253763:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1957
00010000:00010000:3.0:1776191932.410434:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191933.434473:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191933.691073:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5f3bab2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467631005312:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191933.691155:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191933.691254:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631005312
00000100:00100000:1.0:1776191933.691314:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3585
00000100:00100000:1.0:1776191933.691320:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000cddb455 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467631005312:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191933.691367:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191933.691609:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000cddb455 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467631005312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 287us (453us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191933.691617:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3585
00000100:00100000:2.0:1776191933.691679:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5f3bab2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467631005312:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191934.458325:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191934.716571:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776191934.716590:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008bacde2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631005376:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191934.716654:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191934.720770:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631005376
00000100:00100000:3.0:1776191934.720845:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3586
00000100:00100000:3.0:1776191934.720851:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049908ee0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467631005376:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191934.720910:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191934.721006:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049908ee0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467631005376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 154us (4353us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191934.721013:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3586
00000100:00100000:1.0:1776191934.722107:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008bacde2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631005376:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191935.482320:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191935.738216:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191935.738230:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008bacde2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467631005440:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191935.738308:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191935.738346:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003fb0e1f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631005504:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191935.738364:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631005440
00000100:00100000:2.0:1776191935.738374:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191935.738400:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631005504
00000100:00100000:0.0:1776191935.738418:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1807
00000100:00100000:0.0:1776191935.738423:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e5f3bab2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467631005440:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191935.738428:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1808
00000100:00100000:2.0:1776191935.738432:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000025ef566e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631005504:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191935.738451:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00002000:00000024:2.0:1776191935.738451:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191935.738486:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000025ef566e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631005504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (112us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191935.738506:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1808
00000100:00100000:2.0:1776191935.738547:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003fb0e1f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631005504:0@lo:13:osp-pre-0-0.0
00000100:00080000:3.0:1776191935.738677:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191935.738681:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191935.738685:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191935.738689:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4468
00000100:00080000:3.0:1776191935.738691:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1776191935.738695:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191935.738713:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000009eabfd74 x1862467631005888/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191935.738726:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191935.738729:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191935.738730:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191935.738733:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4468
00000100:00080000:3.0:1776191935.738734:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1776191935.738737:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191935.738746:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000057916d34 x1862467631005952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191935.738792:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009eabfd74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631005888:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191935.738820:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191935.738832:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057916d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631005952:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191935.738847:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191935.738890:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000099b06534 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467631005632:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191935.738913:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191935.738926:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5f06cb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467631006016:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191935.738946:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191935.738960:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:3.0:1776191935.738964:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006586b752 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467631005696:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191935.738985:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191935.738998:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000016dc0009 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467631006080:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191935.739015:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191935.739019:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e5f3bab2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467631005440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 595us (712us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191935.739026:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1807
00000100:00100000:3.0:1776191935.739059:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008bacde2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467631005440:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191935.739083:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631005632
00000100:00100000:3.0:1776191935.739114:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631006016
00000100:00100000:3.0:1776191935.739134:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631006080
00000100:00100000:3.0:1776191935.739159:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5280
00000100:00100000:3.0:1776191935.739164:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e3e1154 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467631005632:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191935.739176:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631005888
00000100:00100000:1.0:1776191935.739205:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631005952
00000100:00100000:3.0:1776191935.739206:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e3e1154 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467631005632:12345-0@lo:400:kworker/u8:2.0 Request processed in 41us (292us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191935.739213:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5280
00000100:00100000:1.0:1776191935.739230:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2623
00000100:00100000:3.0:1776191935.739234:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5281
00000100:00100000:1.0:1776191935.739239:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a98c80a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467631005888:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191935.739242:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000067e0c0a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467631006016:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191935.739268:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000067e0c0a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3365:x1862467631006016:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (322us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191935.739273:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5281
00000100:00100000:3.0:1776191935.739282:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5282
00000100:00100000:3.0:1776191935.739285:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004385f089 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467631006080:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191935.739320:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004385f089 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467631006080:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (304us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191935.739325:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5282
00000100:00100000:2.0:1776191935.739371:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086973b12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467631005760:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191935.739396:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:02020000:1.0:1776191935.739510:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191935.739551:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a98c80a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467631005888:12345-0@lo:8:kworker/u8:2.0 Request processed in 312us (730us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191935.739557:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2623
00000100:00100000:1.0:1776191935.739571:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2624
00000100:00100000:1.0:1776191935.739574:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b2bebc0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467631005952:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:1.0:1776191935.739656:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191935.739680:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b2bebc0b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467631005952:12345-0@lo:8:kworker/u8:2.0 Request processed in 104us (832us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191935.739686:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2624
00000100:00100000:2.0:1776191935.743625:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:2.0:1776191935.743646:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006dc48ca9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467631005568:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191935.743726:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191935.743749:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c9664b8e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631005824:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191935.743774:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191935.745670:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631005760
00000100:00100000:3.0:1776191935.746273:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000016dc0009 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467631006080:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191935.746303:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000099b06534 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467631005632:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191935.746325:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5f06cb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3365:1862467631006016:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191935.746506:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631005696
00000100:00100000:3.0:1776191935.746545:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631005824
00000100:00100000:3.0:1776191935.746561:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3587
00000100:00100000:3.0:1776191935.746567:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005f9ce4ac pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467631005696:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191935.746652:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005f9ce4ac pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467631005696:12345-0@lo:400:kworker/u8:2.0 Request processed in 84us (7666us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191935.746659:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3587
00000100:00100000:3.0:1776191935.746677:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3588
00000100:00100000:3.0:1776191935.746680:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000296e59aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631005824:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191935.747260:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5283
00000100:00100000:0.0:1776191935.747265:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003e15780a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467631005760:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191935.747330:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003e15780a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467631005760:12345-0@lo:400:kworker/u8:2.0 Request processed in 64us (7933us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191935.747336:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5283
00000100:00100000:0.0:1776191935.747364:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631005568
00000100:00100000:0.0:1776191935.747388:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1958
00000100:00100000:0.0:1776191935.747391:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fc1666bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467631005568:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191935.747419:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fc1666bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467631005568:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (3694us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191935.747424:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1958
00000100:00080000:0.0:1776191935.747570:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191935.747574:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191935.747578:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009eabfd74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631005888:0@lo:8:kworker/u8:2.0
00000100:00080000:0.0:1776191935.747588:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191935.747591:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191935.747593:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057916d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631005952:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191935.747633:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006dc48ca9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467631005568:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191935.747643:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086973b12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467631005760:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191935.747678:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006586b752 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467631005696:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191935.748574:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c9664b8e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631005824:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191935.748654:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000296e59aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631005824:12345-0@lo:400:kworker/u8:2.0 Request processed in 1972us (4878us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191935.748665:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3588
00010000:00010000:0.0:1776191936.506306:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191937.372652:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191937.372694:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191937.372729:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191937.372777:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191937.372801:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191937.372939:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613831552
00000100:00100000:1.0:1776191937.372991:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613831616
00000100:00100000:1.0:1776191937.373013:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2258
00000100:00100000:1.0:1776191937.373020:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d80d649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613831552:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191937.373137:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d80d649 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613831552:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 116us (443us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191937.373145:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2258
00000100:00100000:1.0:1776191937.373161:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2625
00000100:00100000:1.0:1776191937.373164:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000057916d34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613831616:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:1.0:1776191937.373266:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191937.373290:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000057916d34 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613831616:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 125us (562us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191937.373297:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2625
00000100:00100000:1.0:1776191937.373327:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613831360
00000100:00100000:1.0:1776191937.373346:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1959
00000100:00100000:1.0:1776191937.373351:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000280cef61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613831360:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191937.373373:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000280cef61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2266:x1862467613831360:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 21us (596us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191937.373379:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1959
00000100:00100000:2.0:1776191937.374164:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613831424
00000100:00100000:2.0:1776191937.374192:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613831488
00000100:00100000:2.0:1776191937.374211:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5284
00000100:00100000:2.0:1776191937.374215:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ee7172c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613831424:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191937.374266:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ee7172c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613831424:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 38us (1612us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191937.374273:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5284
00000100:00100000:2.0:1776191937.374286:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5285
00000100:00100000:2.0:1776191937.374291:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a5f06cb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613831488:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191937.374313:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a5f06cb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2266:x1862467613831488:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 23us (1513us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191937.374318:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5285
00010000:00010000:0.0:1776191937.530230:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191938.554256:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191938.810608:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191938.812196:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009eabfd74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467631006144:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191938.812413:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191938.812649:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631006144
00000100:00100000:3.0:1776191938.812726:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3589
00000100:00100000:3.0:1776191938.812732:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000064a5fe4a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467631006144:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191938.812763:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191938.812807:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000064a5fe4a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467631006144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (395us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191938.812813:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3589
00000100:00100000:1.0:1776191938.814742:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009eabfd74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467631006144:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191939.578447:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191939.834880:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776191939.834906:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c3a79bd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631006208:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191939.834971:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191939.835318:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631006208
00000100:00100000:0.0:1776191939.835369:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3590
00000100:00100000:0.0:1776191939.835375:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000040075bf1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467631006208:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191939.835406:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191939.835462:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000040075bf1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467631006208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (491us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191939.835469:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3590
00000100:00100000:2.0:1776191939.835552:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c3a79bd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631006208:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191940.602232:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191940.858428:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191940.858449:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d2780f83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631006272:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191940.858516:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1776191940.858626:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191940.858631:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191940.858633:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191940.858638:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4473
00000100:00080000:0.0:1776191940.858640:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1776191940.858646:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191940.858662:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000128cb0b2 x1862467631006784/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191940.858687:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191940.858691:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191940.858692:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191940.858695:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4473
00000100:00080000:0.0:1776191940.858697:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1776191940.858700:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191940.858711:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000b8ca4c1a x1862467631006848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191940.858743:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631006784:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191940.858766:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191940.858778:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8ca4c1a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631006848:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191940.858794:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191940.858944:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631006272
00000100:00100000:2.0:1776191940.858991:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1809
00000100:00100000:2.0:1776191940.858997:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009eabfd74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631006272:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1776191940.859026:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191940.859087:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009eabfd74 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631006272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (572us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191940.859094:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1809
00000100:00100000:2.0:1776191940.859118:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631006784
00000100:00100000:2.0:1776191940.859134:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631006848
00000100:00100000:2.0:1776191940.859145:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2626
00000100:00100000:2.0:1776191940.859149:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb97b35c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467631006784:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191940.859253:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191940.859289:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb97b35c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467631006784:12345-0@lo:8:kworker/u8:4.0 Request processed in 139us (522us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191940.859295:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2626
00000100:00100000:2.0:1776191940.859306:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2627
00000100:00100000:2.0:1776191940.859310:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba9731d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467631006848:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191940.859392:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191940.859414:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba9731d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467631006848:12345-0@lo:8:kworker/u8:4.0 Request processed in 103us (619us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191940.859419:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2627
00000100:00080000:2.0:1776191940.859453:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191940.859456:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191940.859460:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000128cb0b2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631006784:0@lo:8:kworker/u8:4.0
00000100:00080000:2.0:1776191940.859470:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191940.859472:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191940.859474:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8ca4c1a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631006848:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191940.859500:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1b66093 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467631006400:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191940.859531:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191940.859549:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d799a936 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631006656:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191940.859572:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191940.859589:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:2.0:1776191940.859595:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000635a6f18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467631006464:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191940.859618:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191940.859632:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ebbe68e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631006720:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191940.859653:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191940.859690:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631006656
00000100:00100000:2.0:1776191940.859714:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3591
00000100:00100000:2.0:1776191940.859718:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006503fab3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631006656:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191940.859754:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006503fab3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631006656:12345-0@lo:400:kworker/u8:4.0 Request processed in 35us (182us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191940.859760:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3591
00000100:00100000:2.0:1776191940.859778:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631006400
00000100:00100000:2.0:1776191940.859797:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1960
00000100:00100000:2.0:1776191940.859801:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ea296a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467631006400:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191940.859826:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ea296a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467631006400:12345-0@lo:400:kworker/u8:4.0 Request processed in 24us (295us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191940.859831:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1960
00000100:00100000:2.0:1776191940.859857:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631006464
00000100:00100000:2.0:1776191940.859877:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5286
00000100:00100000:2.0:1776191940.859881:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007670a2b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467631006464:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191940.859905:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007670a2b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467631006464:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (287us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191940.859910:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5286
00000100:00100000:2.0:1776191940.859930:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631006720
00000100:00100000:2.0:1776191940.859946:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2259
00000100:00100000:2.0:1776191940.859950:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fae298a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467631006720:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191940.859975:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fae298a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467631006720:12345-0@lo:400:kworker/u8:4.0 Request processed in 24us (322us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191940.859981:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2259
00000100:00100000:2.0:1776191940.860006:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000635a6f18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467631006464:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191940.860016:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ebbe68e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631006720:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191940.860023:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1b66093 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467631006400:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191940.860029:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d799a936 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631006656:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191940.860476:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006df8bd7e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631006336:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191940.860507:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191940.860529:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000500f9601 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467631006592:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191940.860546:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191940.860558:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004da0b0e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467631006976:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191940.860574:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191940.860598:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d2780f83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631006272:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191940.860611:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:3.0:1776191940.860615:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000354fd625 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631006528:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191940.860633:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191940.860644:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d1c8a441 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467631006912:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191940.860661:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191940.860696:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631006528
00000100:00100000:3.0:1776191940.860717:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3592
00000100:00100000:3.0:1776191940.860721:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005fd6c919 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467631006528:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191940.860751:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005fd6c919 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467631006528:12345-0@lo:400:kworker/u8:4.0 Request processed in 29us (118us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191940.860757:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3592
00000100:00100000:3.0:1776191940.860770:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631006592
00000100:00100000:3.0:1776191940.860783:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631006976
00000100:00100000:3.0:1776191940.860795:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631006912
00000100:00100000:3.0:1776191940.860808:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5287
00000100:00100000:3.0:1776191940.860811:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000852fcdad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467631006592:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191940.860831:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000852fcdad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467631006592:12345-0@lo:400:kworker/u8:4.0 Request processed in 20us (285us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191940.860836:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5287
00000100:00100000:3.0:1776191940.860845:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5288
00000100:00100000:3.0:1776191940.860848:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c3a79bd4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467631006976:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191940.860868:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c3a79bd4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467631006976:12345-0@lo:400:kworker/u8:4.0 Request processed in 19us (294us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191940.860873:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5288
00000100:00100000:3.0:1776191940.860881:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5289
00000100:00100000:3.0:1776191940.860884:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009af94ad9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467631006912:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191940.860901:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009af94ad9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467631006912:12345-0@lo:400:kworker/u8:4.0 Request processed in 17us (241us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191940.860906:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5289
00000100:00100000:3.0:1776191940.860929:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000354fd625 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631006528:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191940.860937:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d1c8a441 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467631006912:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191940.860943:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000500f9601 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467631006592:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191940.860950:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004da0b0e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467631006976:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191940.861176:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631006336
00000100:00100000:0.0:1776191940.861218:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1810
00000100:00100000:0.0:1776191940.861222:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000023d9198f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467631006336:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191940.861236:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191940.861271:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000023d9198f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467631006336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (764us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191940.861276:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1810
00000100:00100000:0.0:1776191940.861323:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006df8bd7e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631006336:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1776191941.626475:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191942.495470:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191942.495508:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191942.495545:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191942.495566:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191942.495586:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191942.495635:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613831936
00000100:00100000:3.0:1776191942.495666:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613831872
00000100:00100000:3.0:1776191942.495690:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2260
00000100:00100000:3.0:1776191942.495696:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000050883ee9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613831872:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191942.496079:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613831808
00000100:00100000:0.0:1776191942.496106:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613831744
00000100:00100000:0.0:1776191942.496122:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5290
00000100:00100000:0.0:1776191942.496126:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d1c8a441 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613831808:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191942.496194:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d1c8a441 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613831808:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 66us (648us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191942.496200:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5290
00000100:00100000:0.0:1776191942.496215:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5291
00000100:00100000:0.0:1776191942.496218:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e724e007 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613831744:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191942.496240:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e724e007 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613831744:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 21us (675us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191942.496245:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5291
00000100:00100000:0.0:1776191942.496265:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2628
00000100:00100000:0.0:1776191942.496268:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004250bccf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613831936:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:0.0:1776191942.496511:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191942.496541:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004250bccf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613831936:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 271us (1078us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191942.496547:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2628
00000100:00100000:2.0:1776191942.496697:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613831680
00000100:00100000:2.0:1776191942.496748:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1961
00000100:00100000:2.0:1776191942.496754:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e58aa936 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613831680:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191942.496783:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e58aa936 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613831680:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 29us (1275us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191942.496789:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1961
00000100:00100000:3.0:1776191942.497263:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000050883ee9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613831872:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 1566us (1675us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191942.497272:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2260
00010000:00010000:0.0:1776191942.650424:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191943.674509:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191943.930674:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1776191943.930696:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004a57869 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467631007040:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191943.930898:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191943.930991:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631007040
00000100:00100000:0.0:1776191943.931097:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3593
00000100:00100000:0.0:1776191943.931104:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c98e876 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467631007040:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191943.931155:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191943.931212:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c98e876 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467631007040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (316us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191943.931219:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3593
00000100:00100000:3.0:1776191943.932165:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004a57869 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467631007040:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191944.703622:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191944.954452:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ba2914d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631007104:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191944.954515:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191944.962154:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631007104
00000100:00100000:1.0:1776191944.962227:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3594
00000100:00100000:1.0:1776191944.962234:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002a98973d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467631007104:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1776191944.962272:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:1.0:1776191944.962340:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002a98973d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467631007104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (7826us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191944.962346:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3594
00000100:00100000:2.0:1776191944.962414:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ba2914d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631007104:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191945.725690:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191945.978680:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1776191945.978696:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be2f7060 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631007168:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191945.978770:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191945.978936:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631007168
00000100:00100000:3.0:1776191945.978983:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1811
00000100:00100000:3.0:1776191945.978989:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004a57869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467631007168:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191945.979017:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191945.979087:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004a57869 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467631007168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (327us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191945.979094:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1811
00000100:00100000:1.0:1776191945.979215:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002599c576 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467631007296:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191945.979247:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191945.979279:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631007296
00000100:00100000:1.0:1776191945.979317:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5292
00000100:00100000:1.0:1776191945.979321:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006062370f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467631007296:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191945.979355:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006062370f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467631007296:12345-0@lo:400:kworker/u8:4.0 Request processed in 33us (108us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191945.979361:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5292
00000100:00100000:1.0:1776191945.979394:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002599c576 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467631007296:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191945.979428:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002599c576 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631007360:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191945.979453:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191945.979479:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631007360
00000100:00100000:1.0:1776191945.979501:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3595
00000100:00100000:1.0:1776191945.979504:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a366bf6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467631007360:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191945.979535:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a366bf6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467631007360:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (82us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191945.979542:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3595
00000100:00100000:1.0:1776191945.979583:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002599c576 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631007360:0@lo:400:kworker/u8:4.0
00000100:00080000:1.0:1776191945.979618:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191945.979623:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191945.979626:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191945.979631:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4478
00000100:00080000:1.0:1776191945.979633:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1776191945.979636:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191945.979645:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fdf2aa68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631007552:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191945.979668:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191945.979702:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000003c03fa37 x1862467631007616/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191945.979715:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191945.979718:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191945.979719:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191945.979722:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4478
00000100:00080000:1.0:1776191945.979724:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1776191945.979727:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191945.979736:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000ebe193c3 x1862467631007680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191945.979953:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631007552
00000100:00100000:3.0:1776191945.979981:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2261
00000100:00100000:3.0:1776191945.979984:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e72ff9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631007552:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191945.980016:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e72ff9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631007552:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (348us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191945.980022:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2261
00000100:00100000:3.0:1776191945.980064:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002599c576 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467631007424:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191945.980101:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191945.980120:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:3.0:1776191945.980124:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000049908ee0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467631007232:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191945.980150:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191945.980161:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467631007488:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191945.980179:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191945.980201:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631007424
00000100:00100000:3.0:1776191945.980229:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5293
00000100:00100000:3.0:1776191945.980232:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ca4bb8b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467631007424:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191945.980263:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ca4bb8b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3365:x1862467631007424:12345-0@lo:400:kworker/u8:4.0 Request processed in 29us (162us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191945.980269:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5293
00000100:00100000:3.0:1776191945.980287:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631007488
00000100:00100000:3.0:1776191945.980317:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3596
00000100:00100000:3.0:1776191945.980321:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000017340e28 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467631007488:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191945.980350:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000017340e28 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467631007488:12345-0@lo:400:kworker/u8:4.0 Request processed in 27us (170us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191945.980355:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3596
00000100:00100000:3.0:1776191945.980385:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467631007488:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191945.980394:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002599c576 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3365:1862467631007424:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191945.980439:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071dfa1cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467631007808:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191945.980458:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191945.980478:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631007808
00000100:00100000:3.0:1776191945.980494:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5294
00000100:00100000:3.0:1776191945.980497:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ba2914d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467631007808:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191945.980523:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ba2914d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467631007808:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (64us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191945.980531:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5294
00000100:00100000:3.0:1776191945.980550:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071dfa1cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467631007808:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191945.980585:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fdf2aa68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631007552:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191945.980856:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d1858cc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467631007744:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191945.980882:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191945.981118:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003c03fa37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631007616:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191945.981152:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191945.981168:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ebe193c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631007680:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191945.981185:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191945.981210:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631007616
00000100:00100000:2.0:1776191945.981228:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631007680
00000100:00100000:2.0:1776191945.981242:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2629
00000100:00100000:2.0:1776191945.981245:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a7a5282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467631007616:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191945.981347:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191945.981379:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a7a5282 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467631007616:12345-0@lo:8:kworker/u8:4.0 Request processed in 133us (226us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191945.981385:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2629
00000100:00100000:2.0:1776191945.981396:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2630
00000100:00100000:2.0:1776191945.981400:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b37332da pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467631007680:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191945.981482:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191945.981503:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b37332da pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467631007680:12345-0@lo:8:kworker/u8:4.0 Request processed in 103us (317us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191945.981509:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2630
00000100:00080000:2.0:1776191945.981533:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191945.981536:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191945.981539:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003c03fa37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631007616:0@lo:8:kworker/u8:4.0
00000100:00080000:2.0:1776191945.981546:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191945.981548:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191945.981562:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ebe193c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631007680:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191945.981935:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631007232
00000100:00100000:0.0:1776191945.981974:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1962
00000100:00100000:0.0:1776191945.981978:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae4705ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467631007232:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191945.982015:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae4705ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467631007232:12345-0@lo:400:kworker/u8:4.0 Request processed in 36us (1865us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191945.982020:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1962
00000100:00100000:0.0:1776191945.982090:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008169e6c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631007872:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191945.982117:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191945.982157:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be2f7060 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631007168:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191945.982187:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631007872
00000100:00100000:0.0:1776191945.982208:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1812
00000100:00100000:0.0:1776191945.982211:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004da0b0e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631007872:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191945.982224:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191945.982254:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004da0b0e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631007872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (137us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191945.982258:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1812
00000100:00100000:0.0:1776191945.982288:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008169e6c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631007872:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191945.982495:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631007744
00000100:00100000:3.0:1776191945.982533:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5295
00000100:00100000:3.0:1776191945.982537:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d5419f64 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467631007744:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191945.982585:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d5419f64 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467631007744:12345-0@lo:400:kworker/u8:4.0 Request processed in 47us (1702us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191945.982591:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5295
00000100:00100000:1.0:1776191945.982711:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000049908ee0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467631007232:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191945.982740:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d1858cc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467631007744:0@lo:400:kworker/u8:4.0
00010000:00010000:0.0:1776191946.747316:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191947.614483:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191947.614533:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191947.614574:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191947.614601:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191947.614669:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191947.614712:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613832000
00000100:00100000:1.0:1776191947.614713:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613832064
00000100:00100000:1.0:1776191947.614758:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613832128
00000100:00100000:1.0:1776191947.614778:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5296
00000100:00100000:1.0:1776191947.614785:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000071dfa1cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613832064:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191947.614856:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071dfa1cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613832064:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 71us (382us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191947.614865:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5296
00000100:00100000:1.0:1776191947.614881:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5297
00000100:00100000:1.0:1776191947.614885:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bedc80a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613832128:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191947.614908:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bedc80a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613832128:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 23us (308us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191947.614914:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5297
00000100:00100000:1.0:1776191947.615084:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613832192
00000100:00100000:1.0:1776191947.615106:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613832256
00000100:00100000:1.0:1776191947.615120:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2262
00000100:00100000:1.0:1776191947.615124:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be2f7060 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613832192:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191947.615154:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be2f7060 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613832192:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 29us (621us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191947.615161:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2262
00000100:00100000:1.0:1776191947.615173:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2631
00000100:00100000:1.0:1776191947.615176:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f947cdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613832256:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:1.0:1776191947.615271:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191947.615296:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f947cdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613832256:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 118us (627us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191947.615302:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2631
00000100:00100000:3.0:1776191947.615330:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1963
00000100:00100000:3.0:1776191947.615337:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000deab4b38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613832000:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191947.615379:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000deab4b38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613832000:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 42us (806us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191947.615386:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1963
00010000:00010000:3.0:1776191947.770941:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191948.796559:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191949.050308:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d3569406 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631007936:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191949.050376:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191949.050598:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631007936
00000100:00100000:0.0:1776191949.050646:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3597
00000100:00100000:0.0:1776191949.050650:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005cfbecd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631007936:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191949.050679:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191949.050727:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005cfbecd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631007936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (352us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191949.050733:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3597
00000100:00100000:1.0:1776191949.050933:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d3569406 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631007936:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191949.819632:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191950.074477:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc2a3d25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631008000:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191950.074555:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191950.075310:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631008000
00000100:00100000:3.0:1776191950.075405:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3598
00000100:00100000:3.0:1776191950.075411:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d1858cc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467631008000:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191950.075453:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191950.075516:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d1858cc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467631008000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (962us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191950.075523:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3598
00000100:00100000:1.0:1776191950.075597:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc2a3d25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631008000:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191950.842841:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191951.098371:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b40a82ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467631008064:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191951.098456:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191951.098550:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631008064
00000100:00100000:1.0:1776191951.098603:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1813
00000100:00100000:1.0:1776191951.098609:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ec7cac8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467631008064:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191951.098637:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191951.098695:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ec7cac8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467631008064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (247us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191951.098703:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1813
00000100:00100000:1.0:1776191951.098737:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d7d52e7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631008128:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191951.098767:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191951.098783:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac03ecb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467631008192:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191951.098802:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631008128
00000100:00100000:3.0:1776191951.098819:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191951.098827:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1814
00000100:00100000:1.0:1776191951.098831:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ebe193c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467631008128:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191951.098841:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191951.098868:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ebe193c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467631008128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (103us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191951.098874:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1814
00000100:00100000:1.0:1776191951.098918:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d7d52e7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631008128:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191951.098950:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b40a82ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467631008064:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191951.103234:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776191951.103254:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fdf2aa68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631008320:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191951.103326:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191951.103378:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631008320
00000100:00100000:1.0:1776191951.103429:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3599
00000100:00100000:1.0:1776191951.103435:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002599c576 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467631008320:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191951.103479:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002599c576 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467631008320:12345-0@lo:400:kworker/u8:4.0 Request processed in 44us (154us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191951.103486:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3599
00000100:00100000:1.0:1776191951.104070:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fdf2aa68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631008320:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191951.104094:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003c03fa37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467631008256:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191951.104125:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191951.104164:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467631008384:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191951.104184:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191951.104213:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191951.104217:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191951.104220:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191951.104224:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4484
00000100:00080000:1.0:1776191951.104226:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1776191951.104230:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191951.104246:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000053bdf8f5 x1862467631008512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191951.104258:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191951.104261:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191951.104262:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191951.104264:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4484
00000100:00080000:1.0:1776191951.104266:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1776191951.104269:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191951.104277:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000008074d522 x1862467631008576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191951.104308:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776191951.104313:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000054025811 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467631008704:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191951.104332:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191951.104353:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631008256
00000100:00100000:1.0:1776191951.104377:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631008384
00000100:00100000:1.0:1776191951.104392:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631008704
00000100:00100000:1.0:1776191951.104409:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5298
00000100:00100000:1.0:1776191951.104413:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fdf2aa68 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467631008256:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191951.104441:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fdf2aa68 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467631008256:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (317us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191951.104446:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5298
00000100:00100000:1.0:1776191951.104458:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5299
00000100:00100000:1.0:1776191951.104460:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049908ee0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467631008384:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191951.104482:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049908ee0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467631008384:12345-0@lo:400:kworker/u8:4.0 Request processed in 21us (298us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191951.104487:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5299
00000100:00100000:1.0:1776191951.104497:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5300
00000100:00100000:1.0:1776191951.104500:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e7bcf21 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467631008704:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191951.104605:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e7bcf21 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467631008704:12345-0@lo:400:kworker/u8:4.0 Request processed in 103us (271us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191951.104611:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5300
00000100:00100000:1.0:1776191951.104647:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000054025811 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467631008704:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191951.104878:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000188ce8c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467631008384:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191951.104899:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b4ee822 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467631008640:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191951.104920:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191951.105053:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003c03fa37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467631008256:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191951.105064:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191951.105069:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000059e49ec2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467631008448:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191951.105094:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191951.105119:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631008448
00000100:00100000:1.0:1776191951.105141:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3600
00000100:00100000:1.0:1776191951.105144:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b8ecdd1c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467631008448:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191951.105175:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b8ecdd1c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467631008448:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (82us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191951.105180:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3600
00000100:00100000:1.0:1776191951.105194:0:6265:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631008640
00000100:00100000:1.0:1776191951.105209:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5301
00000100:00100000:1.0:1776191951.105213:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000054025811 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467631008640:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191951.105238:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000054025811 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467631008640:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (318us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191951.105243:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5301
00000100:00100000:1.0:1776191951.105264:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000059e49ec2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467631008448:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191951.105273:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b4ee822 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467631008640:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191951.105730:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631008192
00000100:00100000:3.0:1776191951.105759:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1964
00000100:00100000:3.0:1776191951.105763:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a4afbcc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467631008192:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191951.105800:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a4afbcc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467631008192:12345-0@lo:400:kworker/u8:4.0 Request processed in 36us (6982us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191951.105806:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1964
00000100:00100000:3.0:1776191951.105841:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac03ecb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467631008192:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191951.106978:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053bdf8f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631008512:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191951.107022:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191951.107262:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008074d522 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631008576:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191951.107289:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191951.107349:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631008512
00000100:00100000:2.0:1776191951.107374:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631008576
00000100:00100000:2.0:1776191951.108020:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632
00000100:00100000:2.0:1776191951.108025:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b40a82ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467631008512:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191951.109105:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191951.109864:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b40a82ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467631008512:12345-0@lo:8:kworker/u8:4.0 Request processed in 1835us (2839us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191951.109875:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632
00000100:00100000:2.0:1776191951.109903:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2633
00000100:00100000:2.0:1776191951.109907:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049d8d6b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467631008576:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191951.110002:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191951.110051:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049d8d6b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467631008576:12345-0@lo:8:kworker/u8:4.0 Request processed in 117us (2736us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191951.110056:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2633
00000100:00080000:2.0:1776191951.110108:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191951.110112:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191951.110116:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053bdf8f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631008512:0@lo:8:kworker/u8:4.0
00000100:00080000:2.0:1776191951.110137:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191951.110139:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191951.110142:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008074d522 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631008576:0@lo:8:kworker/u8:4.0
00010000:00010000:0.0:1776191951.867530:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191952.731832:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191952.731990:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613832320
00000100:00100000:3.0:1776191952.732083:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1965
00000100:00100000:3.0:1776191952.732090:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dbba1dca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613832320:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191952.732154:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dbba1dca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613832320:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 63us (330us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191952.732162:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1965
00000100:00100000:1.0:1776191952.736027:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191952.736190:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613832384
00000100:00100000:0.0:1776191952.736258:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5302
00000100:00100000:0.0:1776191952.736265:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ff74e59 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613832384:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191952.736346:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ff74e59 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613832384:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 80us (325us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191952.736354:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5302
00000100:00100000:1.0:1776191952.744142:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191952.744270:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613832576
00000100:00100000:0.0:1776191952.744415:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2634
00000100:00100000:0.0:1776191952.744423:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c797efb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613832576:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:0.0:1776191952.744531:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191952.744611:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c797efb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613832576:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 186us (477us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191952.744618:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2634
00000100:00100000:1.0:1776191952.749123:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191952.749167:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191952.749447:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613832448
00000100:00100000:2.0:1776191952.749508:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5303
00000100:00100000:2.0:1776191952.749525:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003cf1d110 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613832448:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191952.749610:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003cf1d110 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613832448:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 94us (493us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191952.749619:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5303
00000100:00100000:3.0:1776191952.751072:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613832512
00000100:00100000:3.0:1776191952.751132:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2263
00000100:00100000:3.0:1776191952.751139:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000d666725 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613832512:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191952.751204:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000d666725 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613832512:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 64us (2036us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191952.751211:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2263
00010000:00010000:0.0:1776191952.892602:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191953.914260:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191954.170802:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f598cfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631008768:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191954.170884:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191954.171172:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631008768
00000100:00100000:0.0:1776191954.171222:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3601
00000100:00100000:0.0:1776191954.171229:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003c5d30dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631008768:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191954.171262:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191954.171368:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003c5d30dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631008768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 139us (485us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191954.171376:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3601
00000100:00100000:3.0:1776191954.177335:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f598cfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631008768:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191954.938905:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191955.194518:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191955.194542:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac03ecb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631008832:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191955.194621:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191955.194789:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631008832
00000100:00100000:3.0:1776191955.194847:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3602
00000100:00100000:3.0:1776191955.194862:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9664b8e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467631008832:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191955.194902:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191955.194953:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9664b8e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467631008832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (333us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191955.194960:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3602
00000100:00100000:1.0:1776191955.195217:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac03ecb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631008832:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191955.962226:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191956.218254:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1776191956.218279:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d75056b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631008896:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191956.218346:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191956.218427:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631008896
00000100:00100000:1.0:1776191956.218480:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1815
00000100:00100000:1.0:1776191956.218487:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008ff2a89a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631008896:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191956.218517:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191956.218517:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1776191956.218529:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e9f716d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631008960:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191956.218567:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191956.218573:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008ff2a89a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631008896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (227us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191956.218581:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1815
00000100:00100000:1.0:1776191956.218601:0:8239:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631008960
00000100:00100000:1.0:1776191956.218625:0:8239:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1816
00000100:00100000:1.0:1776191956.218628:0:8239:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2271622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467631008960:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191956.218639:0:8239:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191956.218668:0:8239:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2271622 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467631008960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (101us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191956.218675:0:8239:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1816
00000100:00080000:3.0:1776191956.218679:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191956.218684:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191956.218687:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191956.218693:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4489
00000100:00080000:3.0:1776191956.218695:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1776191956.218697:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ac03ecb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467631009088:0@lo:400:kworker/u8:4.0
00000100:00080000:3.0:1776191956.218701:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191956.218722:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000016dc0009 x1862467631009344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191956.218735:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1776191956.218740:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1776191956.218741:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191956.218743:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191956.218746:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4489
00000100:00080000:3.0:1776191956.218748:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1776191956.218752:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191956.218764:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000d72c3363 x1862467631009408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191956.218782:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d75056b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631008896:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191956.218802:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000b9cbeaa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467631009472:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191956.218826:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191956.218830:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d7d52e7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631009152:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191956.218870:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631009088
00000100:00100000:3.0:1776191956.218875:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191956.218895:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008bacde2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467631009536:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191956.218899:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631009472
00000100:00100000:3.0:1776191956.218924:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191956.218927:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5304
00000100:00100000:1.0:1776191956.218932:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006586b752 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467631009088:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191956.218956:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631009152
00000100:00100000:1.0:1776191956.218975:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006586b752 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467631009088:12345-0@lo:400:kworker/u8:4.0 Request processed in 42us (239us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191956.218981:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5304
00000100:00100000:3.0:1776191956.218991:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3603
00000100:00100000:3.0:1776191956.218997:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a96a54e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467631009152:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191956.218998:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631009536
00000100:00100000:1.0:1776191956.219022:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5305
00000100:00100000:1.0:1776191956.219026:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000086973b12 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467631009472:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191956.219061:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a96a54e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467631009152:12345-0@lo:400:kworker/u8:4.0 Request processed in 63us (187us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191956.219068:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3603
00000100:00100000:1.0:1776191956.219088:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000086973b12 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467631009472:12345-0@lo:400:kworker/u8:4.0 Request processed in 59us (261us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191956.219094:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5306
00000100:00100000:1.0:1776191956.219101:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5305
00000100:00100000:3.0:1776191956.219102:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7cf3eab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467631009536:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191956.219142:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7cf3eab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467631009536:12345-0@lo:400:kworker/u8:4.0 Request processed in 41us (218us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191956.219150:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000b9cbeaa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467631009472:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191956.219150:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5306
00000100:00100000:1.0:1776191956.219163:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ac03ecb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467631009088:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191956.219202:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c1d8acf1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467631009024:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191956.219229:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191956.219241:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007756d7ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631009280:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191956.219257:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191956.219276:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e9f716d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631008960:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191956.219285:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776191956.219289:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc2a3d25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467631009216:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191956.219320:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191956.219375:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000016dc0009 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631009344:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191956.219402:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191956.219417:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d72c3363 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631009408:0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191956.219435:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191956.219530:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631009280
00000100:00100000:0.0:1776191956.219554:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3604
00000100:00100000:0.0:1776191956.219557:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006dc48ca9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631009280:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191956.219586:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006dc48ca9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631009280:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (329us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191956.219591:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3604
00000100:00100000:0.0:1776191956.219615:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631009024
00000100:00100000:0.0:1776191956.219633:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1966
00000100:00100000:0.0:1776191956.219637:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b9375c8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467631009024:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191956.219657:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b9375c8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467631009024:12345-0@lo:400:kworker/u8:4.0 Request processed in 20us (429us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191956.219662:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1966
00000100:00100000:0.0:1776191956.219719:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631009344
00000100:00100000:0.0:1776191956.219734:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631009408
00000100:00100000:0.0:1776191956.219746:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2635
00000100:00100000:0.0:1776191956.219749:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000296e59aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467631009344:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191956.219836:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191956.219876:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000296e59aa pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467631009344:12345-0@lo:8:kworker/u8:4.0 Request processed in 125us (473us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191956.219881:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2635
00000100:00100000:0.0:1776191956.219891:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2636
00000100:00100000:0.0:1776191956.219894:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d75056b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467631009408:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191956.219977:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191956.219996:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d75056b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467631009408:12345-0@lo:8:kworker/u8:4.0 Request processed in 101us (561us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191956.220000:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2636
00000100:00080000:0.0:1776191956.220054:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191956.220058:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191956.220061:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000016dc0009 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631009344:0@lo:8:kworker/u8:4.0
00000100:00080000:0.0:1776191956.220068:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191956.220070:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191956.220072:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d72c3363 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631009408:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191956.220106:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d7d52e7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631009152:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191956.220114:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008bacde2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467631009536:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191956.220475:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c1d8acf1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467631009024:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191956.220488:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007756d7ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631009280:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191956.220551:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631009216
00000100:00100000:0.0:1776191956.220582:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5307
00000100:00100000:0.0:1776191956.220585:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000099b06534 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467631009216:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191956.220618:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000099b06534 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467631009216:12345-0@lo:400:kworker/u8:4.0 Request processed in 32us (1299us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191956.220624:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5307
00000100:00100000:1.0:1776191956.220681:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc2a3d25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467631009216:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191956.992512:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191957.850858:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191957.850906:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191957.850937:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191957.850969:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191957.851071:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613832768
00000100:00100000:3.0:1776191957.851135:0:8672:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613832704
00000100:00100000:3.0:1776191957.851157:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5308
00000100:00100000:3.0:1776191957.851164:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc2a3d25 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613832768:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191957.851236:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc2a3d25 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613832768:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 72us (330us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191957.851245:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5308
00000100:00100000:3.0:1776191957.851261:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5309
00000100:00100000:3.0:1776191957.851265:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c1d8acf1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613832704:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191957.851291:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c1d8acf1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613832704:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 24us (354us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191957.851297:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5309
00000100:00100000:0.0:1776191957.851645:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613832640
00000100:00100000:0.0:1776191957.851692:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1967
00000100:00100000:0.0:1776191957.851697:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fec76140 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613832640:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191957.851729:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fec76140 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613832640:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 32us (880us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191957.851735:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1967
00000100:00100000:0.0:1776191957.851766:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613832832
00000100:00100000:0.0:1776191957.851791:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2264
00000100:00100000:0.0:1776191957.851795:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d7d52e7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613832832:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:0.0:1776191957.851832:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d7d52e7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613832832:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 36us (862us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191957.851838:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2264
00000100:00100000:1.0:1776191957.856259:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191957.856580:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613832896
00000100:00100000:0.0:1776191957.856636:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2637
00000100:00100000:0.0:1776191957.856644:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e8215792 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613832896:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:0.0:1776191957.856766:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191957.856852:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e8215792 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613832896:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 207us (599us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191957.856859:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2637
00010000:00010000:0.0:1776191958.012535:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191959.037987:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191959.293171:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1776191959.293194:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a25bb0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631009600:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191959.293261:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191959.293544:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631009600
00000100:00100000:0.0:1776191959.293595:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3605
00000100:00100000:0.0:1776191959.293602:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008169e6c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631009600:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191959.293635:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191959.294656:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008169e6c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631009600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1048us (1390us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191959.294669:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3605
00000100:00100000:2.0:1776191959.294849:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a25bb0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631009600:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191960.058321:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191960.315456:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1776191960.315474:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eb81ae79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467631009664:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191960.315540:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191960.315632:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631009664
00000100:00100000:0.0:1776191960.315678:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3606
00000100:00100000:0.0:1776191960.315684:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e9f716d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467631009664:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191960.315716:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191960.315821:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e9f716d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467631009664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (281us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191960.315827:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3606
00000100:00100000:3.0:1776191960.318642:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eb81ae79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467631009664:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191961.083389:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191961.338242:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eb81ae79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467631009728:0@lo:400:kworker/u8:2.0
00000100:00080000:3.0:1776191961.338246:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191961.338251:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191961.338254:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191961.338258:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4494
00000100:00080000:3.0:1776191961.338260:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1776191961.338265:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191961.338281:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000f784fad4 x1862467631010176/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:3.0:1776191961.338293:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191961.338295:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191961.338296:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191961.338298:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4494
00000100:00080000:3.0:1776191961.338300:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1776191961.338303:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191961.338310:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000003a98c80a x1862467631010240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191961.338312:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191961.338337:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cd9107bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631009984:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191961.338341:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b048c733 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467631009920:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191961.338363:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191961.338364:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191961.338377:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000481c290f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467631010368:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191961.338377:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b2bebc0b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467631010304:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191961.338396:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191961.338406:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191961.338410:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:3.0:1776191961.338417:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:3.0:1776191961.338422:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0b28322 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631009856:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191961.338425:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aa08bf51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467631009792:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191961.338444:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191961.338457:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000085e6ba1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631010048:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191961.338478:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191961.338522:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631009984
00000100:00100000:0.0:1776191961.338548:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000819bd127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631010432:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191961.338564:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3607
00000100:00100000:1.0:1776191961.338570:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ac03ecb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631009984:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191961.338587:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191961.338595:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191961.338674:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631009920
00000100:00100000:2.0:1776191961.338699:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631010368
00000100:00100000:2.0:1776191961.338715:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631010304
00000100:00100000:2.0:1776191961.338728:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631009792
00000100:00100000:2.0:1776191961.338749:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5310
00000100:00100000:2.0:1776191961.338752:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d80d649 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467631009920:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191961.338805:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ac03ecb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631009984:12345-0@lo:400:kworker/u8:2.0 Request processed in 235us (442us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191961.338822:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3607
00000100:00100000:1.0:1776191961.338840:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631009856
00000100:00100000:1.0:1776191961.338852:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3608
00000100:00100000:1.0:1776191961.338855:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081563597 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467631009856:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191961.338880:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081563597 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467631009856:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (287us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191961.338885:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3608
00000100:00100000:1.0:1776191961.338904:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5311
00000100:00100000:1.0:1776191961.338907:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006467642c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467631010368:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191961.338935:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006467642c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467631010368:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (539us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191961.338940:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5311
00000100:00100000:1.0:1776191961.338951:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5312
00000100:00100000:1.0:1776191961.338954:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b668658 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467631010304:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191961.338972:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b668658 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467631010304:12345-0@lo:400:kworker/u8:2.0 Request processed in 18us (566us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191961.338977:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5312
00000100:00100000:1.0:1776191961.338984:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5313
00000100:00100000:1.0:1776191961.339105:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000546b9ee0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467631009792:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191961.339130:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000546b9ee0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3363:x1862467631009792:12345-0@lo:400:kworker/u8:2.0 Request processed in 143us (687us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191961.339135:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5313
00000100:00100000:1.0:1776191961.339155:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631010048
00000100:00100000:1.0:1776191961.339179:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2265
00000100:00100000:1.0:1776191961.339183:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002cd60e9a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467631010048:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191961.339209:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002cd60e9a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467631010048:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (731us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191961.339215:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2265
00000100:00100000:1.0:1776191961.339404:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d2780f83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467631010496:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191961.339443:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191961.339477:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631010432
00000100:00100000:1.0:1776191961.339507:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631010496
00000100:00100000:1.0:1776191961.339524:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1817
00000100:00100000:1.0:1776191961.339528:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005f9ce4ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467631010432:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191961.339550:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191961.339578:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005f9ce4ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467631010432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (993us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191961.339584:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1817
00000100:00100000:1.0:1776191961.339596:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1818
00000100:00100000:1.0:1776191961.339599:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000050a59c5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467631010496:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:1.0:1776191961.339607:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191961.339631:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000050a59c5e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467631010496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 31us (189us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191961.339636:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1818
00000100:00100000:1.0:1776191961.339987:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d2780f83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467631010496:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191961.340059:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f784fad4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631010176:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191961.347540:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0b28322 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631009856:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191961.347558:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1da7374 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631010112:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191961.347626:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191961.348060:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000819bd127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631010432:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191961.348126:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631010112
00000100:00100000:0.0:1776191961.348168:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2266
00000100:00100000:0.0:1776191961.348174:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a1b8127c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631010112:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191961.348326:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a1b8127c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631010112:12345-0@lo:400:kworker/u8:2.0 Request processed in 150us (700us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191961.348329:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631009728
00000100:00100000:0.0:1776191961.348337:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2266
00000100:00100000:3.0:1776191961.348362:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1968
00000100:00100000:3.0:1776191961.348368:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cdaa8581 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467631009728:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191961.348402:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cdaa8581 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3363:x1862467631009728:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (10092us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191961.348409:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1968
00000100:00100000:0.0:1776191961.349058:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aa08bf51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3363:1862467631009792:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191961.349076:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000085e6ba1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631010048:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191961.349085:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cd9107bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631009984:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191961.349095:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000481c290f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467631010368:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191961.349103:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eb81ae79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3363:1862467631009728:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191961.349193:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b2bebc0b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467631010304:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191961.349212:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1da7374 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631010112:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191961.349357:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191961.349375:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a98c80a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631010240:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191961.349412:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191961.349439:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631010176
00000100:00100000:1.0:1776191961.349465:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631010240
00000100:00100000:1.0:1776191961.350061:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2638
00000100:00100000:0.0:1776191961.350070:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2639
00000100:00100000:1.0:1776191961.350071:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f53454d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467631010176:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191961.350079:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d7d52e7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467631010240:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:0.0:1776191961.350178:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191961.350222:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d7d52e7c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3362:x1862467631010240:12345-0@lo:8:kworker/u8:2.0 Request processed in 143us (809us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191961.350229:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2639
00000100:00080000:0.0:1776191961.350272:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191961.350277:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191961.350281:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a98c80a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631010240:0@lo:8:kworker/u8:2.0
00010000:02020000:1.0:1776191961.350603:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191961.350651:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f53454d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467631010176:12345-0@lo:8:kworker/u8:2.0 Request processed in 583us (1295us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191961.350658:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2638
00000100:00100000:2.0:1776191961.350795:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d80d649 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467631009920:12345-0@lo:400:kworker/u8:2.0 Request processed in 12041us (12430us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191961.350803:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5310
00000100:00080000:0.0:1776191961.352015:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191961.352022:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191961.352028:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f784fad4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631010176:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191961.352792:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b048c733 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467631009920:0@lo:400:kworker/u8:2.0
00010000:00010000:0.0:1776191962.106622:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191962.970629:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191962.970759:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613833216
00000100:00100000:1.0:1776191962.970811:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2640
00000100:00100000:1.0:1776191962.970818:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d2780f83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613833216:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:1.0:1776191962.970916:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191962.970990:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d2780f83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613833216:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 172us (369us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191962.970998:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2640
00000100:00100000:3.0:1776191962.971269:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191962.971514:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191962.971548:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191962.971580:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191962.971591:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613833152
00000100:00100000:2.0:1776191962.971625:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613832960
00000100:00100000:1.0:1776191962.971629:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2267
00000100:00100000:1.0:1776191962.971635:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ea373370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613833152:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191962.971659:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1969
00000100:00100000:2.0:1776191962.971665:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009803db2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613832960:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191962.971682:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ea373370 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613833152:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 46us (169us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191962.971690:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2267
00000100:00100000:2.0:1776191962.971700:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009803db2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613832960:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 33us (151us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191962.971720:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1969
00000100:00100000:0.0:1776191962.972058:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613833024
00000100:00100000:0.0:1776191962.972194:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613833088
00000100:00100000:2.0:1776191962.972228:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5314
00000100:00100000:2.0:1776191962.972233:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7098b67 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613833024:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191962.972282:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7098b67 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613833024:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 48us (1014us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191962.972289:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5314
00000100:00100000:2.0:1776191962.972302:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5315
00000100:00100000:2.0:1776191962.972306:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000023fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613833088:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191962.972328:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000023fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613833088:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 21us (749us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191962.972333:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5315
00010000:00010000:3.0:1776191963.131139:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191964.154480:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191964.410289:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1776191964.410304:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000819bd127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467631010560:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191964.410373:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191964.410481:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631010560
00000100:00100000:3.0:1776191964.410530:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3609
00000100:00100000:3.0:1776191964.410535:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000780602c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467631010560:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1776191964.410566:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:3.0:1776191964.410616:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000780602c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467631010560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (243us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191964.410623:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3609
00000100:00100000:2.0:1776191964.410708:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000819bd127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467631010560:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191965.178269:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191965.434436:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a133ee9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631010624:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191965.434509:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191965.434828:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631010624
00000100:00100000:3.0:1776191965.434907:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3610
00000100:00100000:3.0:1776191965.434913:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008bacde2f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467631010624:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191965.434945:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191965.434991:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008bacde2f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467631010624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (483us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191965.434998:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3610
00000100:00100000:3.0:1776191965.435076:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a133ee9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631010624:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191966.203476:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191966.458520:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fae298a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467631010688:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191966.458599:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1776191966.458940:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191966.458945:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191966.458948:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1776191966.458951:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631010688
00000100:00080000:2.0:1776191966.458953:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4499
00000100:00080000:2.0:1776191966.458967:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1776191966.458972:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191966.458999:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1819
00000100:00100000:2.0:1776191966.459002:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000006df8bd7e x1862467631011136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191966.459004:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d72c3363 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467631010688:12345-0@lo:13:osp-pre-0-0.0
00000100:00080000:2.0:1776191966.459016:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191966.459019:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191966.459021:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191966.459024:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4499
00000100:00080000:2.0:1776191966.459025:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1776191966.459029:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00002000:00000024:0.0:1776191966.459047:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191966.459067:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000500f9601 x1862467631011200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191966.459087:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d72c3363 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467631010688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (490us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191966.459094:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1819
00000100:00100000:0.0:1776191966.459119:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006df8bd7e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631011136:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191966.459146:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191966.459160:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000500f9601 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631011200:0@lo:8:kworker/u8:2.0
00000100:00100000:0.0:1776191966.459179:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191966.459246:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b40a82ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631010880:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191966.459276:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191966.459299:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000354fd625 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467631011264:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191966.459323:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191966.459341:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:3.0:1776191966.459345:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000049d8d6b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467631010944:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191966.459364:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191966.459375:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d799a936 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467631011328:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191966.459393:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191966.459420:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631011264
00000100:00100000:2.0:1776191966.459421:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631010944
00000100:00100000:1.0:1776191966.459485:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631010880
00000100:00100000:1.0:1776191966.459511:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3611
00000100:00100000:1.0:1776191966.459514:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a133ee9d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467631010880:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191966.459547:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a133ee9d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467631010880:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (272us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191966.459553:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3611
00000100:00100000:1.0:1776191966.459570:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b37332da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467631010816:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191966.459590:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191966.459615:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631011328
00000100:00100000:3.0:1776191966.461409:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631010816
00000100:00100000:3.0:1776191966.461451:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5316
00000100:00100000:3.0:1776191966.461457:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a5a67c63 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467631010944:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191966.461515:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d75056b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631011072:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191966.461516:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a5a67c63 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467631010944:12345-0@lo:400:kworker/u8:2.0 Request processed in 58us (2150us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191966.461527:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5316
00000100:00100000:3.0:1776191966.461544:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5317
00000100:00100000:3.0:1776191966.461548:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d335ff71 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467631011264:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191966.461563:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191966.461579:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d335ff71 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467631011264:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (2256us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191966.461585:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5317
00000100:00100000:1.0:1776191966.461594:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [2->3]
00000100:00100000:3.0:1776191966.461598:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5318
00000100:00100000:3.0:1776191966.461602:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000044860d59 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467631011328:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191966.461606:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008a7a5282 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467631010752:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191966.461645:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000044860d59 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3363:x1862467631011328:12345-0@lo:400:kworker/u8:2.0 Request processed in 41us (2250us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191966.461651:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5318
00000100:00100000:1.0:1776191966.461665:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191966.461670:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5319
00000100:00100000:3.0:1776191966.461674:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000b9cbeaa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467631010816:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191966.461689:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000296e59aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631011008:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191966.464484:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000049d8d6b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467631010944:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191966.464504:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d799a936 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3363:1862467631011328:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191966.464515:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b40a82ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631010880:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191966.464525:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000354fd625 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467631011264:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191966.464573:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631011136
00000100:00100000:1.0:1776191966.465180:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631011200
00000100:00100000:1.0:1776191966.465467:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631011072
00000100:00100000:1.0:1776191966.465498:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2268
00000100:00100000:1.0:1776191966.465505:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008074d522 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467631011072:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191966.465574:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008074d522 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467631011072:12345-0@lo:400:kworker/u8:2.0 Request processed in 69us (4012us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191966.465581:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2268
00000100:00100000:1.0:1776191966.465598:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2641
00000100:00100000:1.0:1776191966.465601:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000819bd127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467631011136:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191966.465729:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2642
00000100:00100000:2.0:1776191966.465734:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a25bb0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467631011200:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:1.0:1776191966.465746:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191966.465784:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000819bd127 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467631011136:12345-0@lo:8:kworker/u8:2.0 Request processed in 181us (6637us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191966.465791:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2641
00010000:02020000:2.0:1776191966.465819:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191966.465836:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631010752
00000100:00100000:2.0:1776191966.465860:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a25bb0a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467631011200:12345-0@lo:8:kworker/u8:2.0 Request processed in 124us (6679us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191966.465865:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1970
00000100:00100000:2.0:1776191966.465871:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2642
00000100:00100000:1.0:1776191966.465873:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000364ff3a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467631010752:12345-0@lo:400:kworker/u8:2.0
00000100:00080000:2.0:1776191966.465941:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191966.465946:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191966.465950:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006df8bd7e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631011136:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191966.466260:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000364ff3a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467631010752:12345-0@lo:400:kworker/u8:2.0 Request processed in 387us (4598us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191966.466267:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1970
00000100:00100000:1.0:1776191966.466317:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fae298a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467631010688:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191966.466351:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191966.466377:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1b66093 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631011392:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1776191966.466397:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1776191966.466401:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191966.466407:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191966.466408:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000500f9601 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631011200:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191966.466438:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b37332da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467631010816:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191966.466443:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631011008
00000100:00100000:1.0:1776191966.466452:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d75056b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631011072:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191966.466477:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008a7a5282 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467631010752:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191966.466477:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3612
00000100:00100000:2.0:1776191966.466486:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000053bdf8f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631011008:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191966.466515:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631011392
00000100:00100000:2.0:1776191966.466534:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000053bdf8f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631011008:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (182us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191966.466542:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3612
00000100:00100000:1.0:1776191966.466545:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1820
00000100:00100000:1.0:1776191966.466551:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b4ee822 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467631011392:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191966.466565:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191966.466574:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000296e59aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631011008:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191966.466608:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b4ee822 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467631011392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (202us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191966.466614:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1820
00000100:00100000:2.0:1776191966.467416:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1b66093 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631011392:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191966.467840:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000b9cbeaa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467631010816:12345-0@lo:400:kworker/u8:2.0 Request processed in 6163us (8247us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191966.467850:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5319
00010000:00010000:0.0:1776191967.226206:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191968.094758:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191968.094806:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191968.094895:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191968.094939:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613833536
00000100:00100000:2.0:1776191968.094984:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613833472
00000100:00100000:2.0:1776191968.095014:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2269
00000100:00100000:2.0:1776191968.095021:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003c03fa37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613833472:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191968.095119:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003c03fa37 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2266:x1862467613833472:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 97us (225us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191968.095126:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2269
00000100:00100000:2.0:1776191968.095144:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2643
00000100:00100000:2.0:1776191968.095152:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000059e49ec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613833536:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:2.0:1776191968.095249:0:13323:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191968.095276:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000059e49ec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2262:x1862467613833536:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 127us (527us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191968.095282:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2643
00000100:00100000:3.0:1776191968.096988:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191968.097083:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191968.097130:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613833280
00000100:00100000:1.0:1776191968.097180:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1971
00000100:00100000:1.0:1776191968.097187:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ea43294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613833280:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191968.097471:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ea43294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613833280:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 282us (488us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191968.097480:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1971
00000100:00100000:0.0:1776191968.100532:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613833344
00000100:00100000:0.0:1776191968.100663:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613833408
00000100:00100000:1.0:1776191968.100833:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5320
00000100:00100000:1.0:1776191968.100840:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e72ff9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613833344:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191968.100965:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e72ff9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2266:x1862467613833344:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 125us (6159us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191968.100973:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5320
00000100:00100000:1.0:1776191968.100990:0:6265:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5321
00000100:00100000:1.0:1776191968.100994:0:6265:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c251e98f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613833408:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:1.0:1776191968.101018:0:6265:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c251e98f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613833408:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 24us (3937us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191968.101023:0:6265:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5321
00010000:00010000:0.0:1776191968.250259:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191969.274357:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191969.530280:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1776191969.530292:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f598cfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467631011456:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191969.531729:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191969.532063:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631011456
00000100:00100000:0.0:1776191969.532124:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3613
00000100:00100000:0.0:1776191969.532131:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000188ce8c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467631011456:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191969.532168:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191969.532239:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000188ce8c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467631011456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (514us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191969.532246:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3613
00000100:00100000:1.0:1776191969.532805:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f598cfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467631011456:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191970.298304:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191970.554547:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1b66093 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631011520:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191970.554618:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191970.554716:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631011520
00000100:00100000:0.0:1776191970.554769:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3614
00000100:00100000:0.0:1776191970.554775:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1fe5010 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467631011520:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191970.554808:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191970.554859:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1fe5010 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467631011520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (242us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191970.554867:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3614
00000100:00100000:3.0:1776191970.554997:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1b66093 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631011520:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191971.324377:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191971.578617:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004f9388e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467631011648:0@lo:400:kworker/u8:2.0
00000100:00080000:3.0:1776191971.578641:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191971.578646:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191971.578650:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191971.578656:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4504
00000100:00080000:3.0:1776191971.578658:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1776191971.578664:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191971.578695:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000ec42a12f x1862467631012096/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191971.578708:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1776191971.578718:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1776191971.578722:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1776191971.578725:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1776191971.578728:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4504
00000100:00080000:3.0:1776191971.578730:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1776191971.578734:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:3.0:1776191971.578745:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000af172616 x1862467631012160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191971.578750:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086a13048 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467631011904:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191971.578784:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f210a7b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631011776:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191971.578791:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191971.578814:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e56aacf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467631012288:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191971.578821:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191971.578846:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009df06d88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631012032:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191971.578851:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191971.578875:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191971.578889:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:1.0:1776191971.578897:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000603b89b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467631011712:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191971.578899:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [1->0]
00000100:00100000:3.0:1776191971.578908:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000500f9601 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631011584:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191971.578930:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191971.578944:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191971.578949:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000182c146b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467631011968:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191971.578979:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aaba3ebf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467631011840:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191971.578984:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191971.579013:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191971.579026:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631011648
00000100:00100000:3.0:1776191971.579064:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027e578e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467631012224:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191971.579089:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191971.579093:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1972
00000100:00100000:1.0:1776191971.579099:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d186bef1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467631011648:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191971.579117:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631012096:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191971.579142:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191971.579157:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000af172616 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631012160:0@lo:8:kworker/u8:2.0
00000100:00100000:1.0:1776191971.579167:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d186bef1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467631011648:12345-0@lo:400:kworker/u8:2.0 Request processed in 65us (463us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191971.579175:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1972
00000100:00100000:3.0:1776191971.579191:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191971.579219:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631011584
00000100:00100000:3.0:1776191971.579247:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1821
00000100:00100000:3.0:1776191971.579251:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000352f4840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631011584:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191971.579275:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191971.579308:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000352f4840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631011584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (366us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191971.579314:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1821
00000100:00100000:3.0:1776191971.579332:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631011904
00000100:00100000:3.0:1776191971.579355:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631011776
00000100:00100000:3.0:1776191971.579371:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3615
00000100:00100000:3.0:1776191971.579375:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000057916d34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467631011904:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191971.579388:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631012288
00000100:00100000:3.0:1776191971.579410:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000057916d34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467631011904:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (623us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191971.579417:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3615
00000100:00100000:1.0:1776191971.579423:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631011712
00000100:00100000:3.0:1776191971.579433:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3616
00000100:00100000:3.0:1776191971.579438:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c8cf6d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467631011776:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191971.579444:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631011840
00000100:00100000:1.0:1776191971.579466:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631012224
00000100:00100000:3.0:1776191971.579471:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c8cf6d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467631011776:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (650us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191971.579478:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3616
00000100:00100000:1.0:1776191971.579483:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5322
00000100:00100000:1.0:1776191971.579489:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004250bccf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467631012288:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191971.579502:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631012032
00000100:00100000:1.0:1776191971.579540:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004250bccf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3365:x1862467631012288:12345-0@lo:400:kworker/u8:2.0 Request processed in 49us (688us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191971.579542:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631011968
00000100:00100000:1.0:1776191971.579549:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5322
00000100:00100000:3.0:1776191971.579567:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631012096
00000100:00100000:1.0:1776191971.579570:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5323
00000100:00100000:1.0:1776191971.579575:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb97b35c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467631011712:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191971.579581:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631012160
00000100:00100000:3.0:1776191971.579594:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2270
00000100:00100000:3.0:1776191971.579600:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000076ea9d35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631012032:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191971.579607:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb97b35c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3365:x1862467631011712:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (678us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191971.579614:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5323
00000100:00100000:1.0:1776191971.579628:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5324
00000100:00100000:1.0:1776191971.579632:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ca0ac87b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467631011840:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191971.579637:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000076ea9d35 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631012032:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (763us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191971.579645:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2270
00000100:00100000:3.0:1776191971.579661:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2271
00000100:00100000:1.0:1776191971.579666:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ca0ac87b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467631011840:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (652us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191971.579667:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba9731d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467631011968:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191971.579680:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5324
00000100:00100000:3.0:1776191971.579703:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba9731d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467631011968:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (722us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191971.579710:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2271
00000100:00100000:3.0:1776191971.579721:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2644
00000100:00100000:3.0:1776191971.579724:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ac3eb660 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467631012096:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191971.579818:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191971.579852:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ac3eb660 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467631012096:12345-0@lo:8:kworker/u8:2.0 Request processed in 126us (710us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191971.579858:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2644
00000100:00100000:3.0:1776191971.579868:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2645
00000100:00100000:3.0:1776191971.579871:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c049762 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467631012160:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:3.0:1776191971.579954:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191971.579976:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c049762 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3362:x1862467631012160:12345-0@lo:8:kworker/u8:2.0 Request processed in 104us (786us total) trans 0 rc -19/-19
00000100:00100000:3.0:1776191971.579982:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2645
00000100:00080000:3.0:1776191971.580011:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191971.580014:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191971.580017:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec42a12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631012096:0@lo:8:kworker/u8:2.0
00000100:00080000:3.0:1776191971.580025:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191971.580027:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191971.580029:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000af172616 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631012160:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191971.580086:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000500f9601 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631011584:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1776191971.580096:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aaba3ebf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467631011840:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191971.580103:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f210a7b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631011776:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191971.580110:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009df06d88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631012032:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191971.580168:0:8672:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5325
00000100:00100000:3.0:1776191971.580178:0:8672:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ab16a8b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467631012224:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191971.580216:0:8672:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ab16a8b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3363:x1862467631012224:12345-0@lo:400:kworker/u8:2.0 Request processed in 43us (1127us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191971.580221:0:8672:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5325
00000100:00100000:3.0:1776191971.580256:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027e578e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3363:1862467631012224:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191971.580282:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000603b89b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3365:1862467631011712:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191971.580297:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000182c146b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467631011968:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191971.580310:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e56aacf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3365:1862467631012288:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191971.580323:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086a13048 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467631011904:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191971.580336:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004f9388e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467631011648:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191971.581140:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1776191971.581153:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d3569406 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467631012352:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191971.581206:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191971.581388:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631012352
00000100:00100000:0.0:1776191971.581429:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1822
00000100:00100000:0.0:1776191971.581434:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d2e07ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467631012352:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1776191971.581453:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191971.581500:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d2e07ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3365:x1862467631012352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (295us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191971.581506:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1822
00000100:00100000:2.0:1776191971.581691:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d3569406 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467631012352:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1776191972.350546:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191973.215462:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191973.215518:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191973.215553:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191973.215646:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191973.215684:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613833600
00000100:00100000:2.0:1776191973.215732:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1973
00000100:00100000:2.0:1776191973.215739:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000050bd026a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613833600:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191973.215808:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000050bd026a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613833600:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 69us (163us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191973.215816:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1973
00000100:00100000:1.0:1776191973.216148:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613833664
00000100:00100000:1.0:1776191973.216190:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5326
00000100:00100000:1.0:1776191973.216204:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000354fd625 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613833664:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191973.216249:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000354fd625 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613833664:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 44us (732us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191973.216255:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5326
00000100:00100000:3.0:1776191973.217130:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613833856
00000100:00100000:3.0:1776191973.217155:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613833792
00000100:00100000:3.0:1776191973.217180:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2272
00000100:00100000:3.0:1776191973.217184:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d799a936 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613833792:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191973.217270:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2646
00000100:00100000:1.0:1776191973.217275:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006df8bd7e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613833856:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:1.0:1776191973.217375:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191973.217750:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006df8bd7e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2262:x1862467613833856:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 473us (2293us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191973.217759:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2646
00000100:00100000:3.0:1776191973.217882:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d799a936 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613833792:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 696us (2328us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191973.217889:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2272
00000100:00100000:2.0:1776191973.218053:0:3357:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191973.218628:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613833728
00000100:00100000:3.0:1776191973.218718:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5327
00000100:00100000:3.0:1776191973.218723:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ebbe68e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613833728:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:3.0:1776191973.218786:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ebbe68e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613833728:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 61us (752us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191973.218868:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5327
00010000:00010000:0.0:1776191973.370293:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191974.394302:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191974.651501:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191974.651520:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001dcb8edb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467631012416:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191974.651592:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191974.651728:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631012416
00000100:00100000:0.0:1776191974.651776:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3617
00000100:00100000:0.0:1776191974.651782:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036447325 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467631012416:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191974.651818:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191974.652005:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036447325 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467631012416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 222us (413us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191974.652017:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3617
00000100:00100000:1.0:1776191974.653159:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001dcb8edb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467631012416:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191975.418581:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191975.674967:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000635a6f18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631012480:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191975.675058:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191975.675146:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631012480
00000100:00100000:0.0:1776191975.675193:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3618
00000100:00100000:0.0:1776191975.675199:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c477a6c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467631012480:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1776191975.675230:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:0.0:1776191975.675283:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c477a6c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467631012480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (226us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191975.675290:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3618
00000100:00100000:2.0:1776191975.675494:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000635a6f18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631012480:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191976.443458:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191976.698580:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1776191976.698641:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000290b34e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631012544:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191976.698706:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191976.698775:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1776191976.698783:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e8375317 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467631012608:0@lo:13:osp-pre-0-0.0
00000100:00080000:1.0:1776191976.698965:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191976.698970:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191976.698973:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191976.698978:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4509
00000100:00080000:1.0:1776191976.698981:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1776191976.698986:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191976.699004:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000542b51d0 x1862467631013120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191976.699019:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191976.699021:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191976.699023:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191976.699026:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4509
00000100:00080000:1.0:1776191976.699027:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1776191976.699030:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191976.699063:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000a3b02dc8 x1862467631013184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191976.699093:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a79a08f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467631012736:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191976.699122:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191976.699148:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a035eb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631012992:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191976.699168:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191976.699184:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [0->1]
00000100:00100000:1.0:1776191976.699189:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000254994e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467631012672:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191976.699227:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191976.699241:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c243e42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467631012928:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191976.699261:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191976.699274:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057cf3599 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467631013312:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191976.699291:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191976.699318:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631012928
00000100:00100000:1.0:1776191976.699351:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3619
00000100:00100000:1.0:1776191976.699357:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa41a1c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467631012928:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191976.699415:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa41a1c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467631012928:12345-0@lo:400:kworker/u8:4.0 Request processed in 48us (143us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191976.699423:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3619
00000100:00100000:1.0:1776191976.699460:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c243e42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467631012928:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191976.699483:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631012672
00000100:00100000:1.0:1776191976.699506:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1974
00000100:00100000:1.0:1776191976.699509:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008cbd400d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467631012672:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191976.699539:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008cbd400d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467631012672:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (312us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191976.699545:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1974
00000100:00100000:1.0:1776191976.699571:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000254994e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467631012672:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191976.699590:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631012736
00000100:00100000:1.0:1776191976.699611:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631013312
00000100:00100000:1.0:1776191976.699628:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5328
00000100:00100000:1.0:1776191976.699632:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c904ec5f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467631012736:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191976.699662:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c904ec5f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467631012736:12345-0@lo:400:kworker/u8:4.0 Request processed in 29us (540us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191976.699668:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5328
00000100:00100000:1.0:1776191976.699679:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5329
00000100:00100000:1.0:1776191976.699683:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000038340710 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467631013312:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191976.699705:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000038340710 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467631013312:12345-0@lo:400:kworker/u8:4.0 Request processed in 22us (414us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191976.699710:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5329
00000100:00100000:1.0:1776191976.699733:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057cf3599 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467631013312:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191976.699741:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a79a08f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467631012736:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191976.699774:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631012992
00000100:00100000:1.0:1776191976.699797:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2273
00000100:00100000:1.0:1776191976.699800:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005fa5d8be pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467631012992:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191976.699831:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005fa5d8be pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467631012992:12345-0@lo:400:kworker/u8:4.0 Request processed in 29us (662us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191976.699836:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2273
00000100:00100000:1.0:1776191976.699857:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000542b51d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631013120:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191976.699881:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191976.699895:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a3b02dc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631013184:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191976.699915:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191976.699940:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631013120
00000100:00100000:1.0:1776191976.699954:0:8236:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631013184
00000100:00100000:1.0:1776191976.699968:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2647
00000100:00100000:1.0:1776191976.699971:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a79a08f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467631013120:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191976.700092:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191976.700124:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a79a08f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467631013120:12345-0@lo:8:kworker/u8:4.0 Request processed in 152us (243us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191976.700131:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2647
00000100:00100000:1.0:1776191976.700141:0:8236:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2648
00000100:00100000:1.0:1776191976.700144:0:8236:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000057cf3599 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467631013184:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:1.0:1776191976.700226:0:8236:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191976.700251:0:8236:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000057cf3599 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3362:x1862467631013184:12345-0@lo:8:kworker/u8:4.0 Request processed in 106us (336us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191976.700256:0:8236:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2648
00000100:00080000:1.0:1776191976.700279:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191976.700283:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191976.700286:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000542b51d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631013120:0@lo:8:kworker/u8:4.0
00000100:00080000:1.0:1776191976.700293:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191976.700295:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191976.700297:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a3b02dc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631013184:0@lo:8:kworker/u8:4.0
00000100:00100000:1.0:1776191976.700327:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a035eb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631012992:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191976.700459:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000841b9634 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467631012864:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191976.700485:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191976.700500:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048d62137 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467631013248:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191976.700518:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191976.700531:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:2.0:1776191976.700536:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003f3f309a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631012800:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191976.700555:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191976.700570:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d10ef768 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631013056:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191976.700587:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191976.700618:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631012864
00000100:00100000:2.0:1776191976.700642:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631013248
00000100:00100000:2.0:1776191976.700658:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5330
00000100:00100000:2.0:1776191976.700662:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001ab68509 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467631012864:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191976.700695:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001ab68509 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467631012864:12345-0@lo:400:kworker/u8:4.0 Request processed in 32us (210us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191976.700700:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5330
00000100:00100000:2.0:1776191976.700711:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5331
00000100:00100000:2.0:1776191976.700715:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009592900a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467631013248:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191976.700737:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009592900a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467631013248:12345-0@lo:400:kworker/u8:4.0 Request processed in 22us (219us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191976.700742:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5331
00000100:00100000:2.0:1776191976.700760:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631013056
00000100:00100000:2.0:1776191976.700779:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2274
00000100:00100000:2.0:1776191976.700783:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e920d54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631013056:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191976.700808:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e920d54 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631013056:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (221us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191976.700814:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2274
00000100:00100000:2.0:1776191976.700832:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631012800
00000100:00100000:2.0:1776191976.700851:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3620
00000100:00100000:2.0:1776191976.700855:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000056d339e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467631012800:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191976.700880:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000056d339e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467631012800:12345-0@lo:400:kworker/u8:4.0 Request processed in 25us (324us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191976.700886:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3620
00000100:00100000:2.0:1776191976.700910:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003f3f309a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631012800:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191976.700918:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d10ef768 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631013056:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191976.700927:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000841b9634 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467631012864:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191976.700935:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048d62137 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467631013248:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191976.701145:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631012544
00000100:00100000:3.0:1776191976.701231:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1823
00000100:00100000:3.0:1776191976.701235:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000635a6f18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467631012544:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191976.701259:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191976.701293:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000635a6f18 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467631012544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (2588us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191976.701299:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1823
00000100:00100000:2.0:1776191976.701362:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000290b34e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631012544:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191976.701756:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191976.702129:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631012608
00000100:00100000:3.0:1776191976.702162:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1824
00000100:00100000:3.0:1776191976.702165:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002a035eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467631012608:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191976.702180:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191976.702224:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002a035eb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3365:x1862467631012608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (469us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191976.702229:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1824
00000100:00100000:1.0:1776191976.702333:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e8375317 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3365:1862467631012608:0@lo:13:osp-pre-0-0.0
00010000:00010000:0.0:1776191977.470977:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191978.333460:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191978.333519:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191978.333550:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191978.333580:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191978.333617:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191978.333659:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613834048
00000100:00100000:0.0:1776191978.333710:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613833984
00000100:00100000:0.0:1776191978.333731:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5332
00000100:00100000:0.0:1776191978.333747:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027bfcbd4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613834048:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191978.333826:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027bfcbd4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613834048:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 77us (275us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191978.333834:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5332
00000100:00100000:0.0:1776191978.333858:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5333
00000100:00100000:0.0:1776191978.333863:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2c7adec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613833984:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191978.333887:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2c7adec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613833984:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 24us (307us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191978.333894:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5333
00000100:00100000:0.0:1776191978.333914:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613834176
00000100:00100000:0.0:1776191978.333927:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613834112
00000100:00100000:0.0:1776191978.333946:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2275
00000100:00100000:0.0:1776191978.333950:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ff6c3c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613834112:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:0.0:1776191978.333973:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ff6c3c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613834112:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 22us (366us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191978.333979:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2275
00000100:00100000:0.0:1776191978.333991:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2649
00000100:00100000:0.0:1776191978.333994:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f3989c1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613834176:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:0.0:1776191978.334153:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191978.334179:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f3989c1b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613834176:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 184us (728us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191978.334185:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2649
00000100:00100000:3.0:1776191978.336708:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613833920
00000100:00100000:3.0:1776191978.337489:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1975
00000100:00100000:3.0:1776191978.337496:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000afc79a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613833920:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191978.337574:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000afc79a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613833920:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 77us (4055us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191978.337581:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1975
00010000:00010000:3.0:1776191978.493876:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191979.514779:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191979.770727:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1776191979.776281:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000138721a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631013376:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1776191979.776369:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191979.776519:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631013376
00000100:00100000:0.0:1776191979.776612:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3621
00000100:00100000:0.0:1776191979.776618:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000746b7981 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631013376:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191979.776656:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191979.776707:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000746b7981 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631013376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (338us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191979.776715:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3621
00000100:00100000:3.0:1776191979.776779:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000138721a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631013376:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191980.538316:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191980.798795:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002986576f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467631013440:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191980.798865:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191980.799068:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631013440
00000100:00100000:3.0:1776191980.799117:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3622
00000100:00100000:3.0:1776191980.799123:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a3b02dc8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467631013440:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191980.799155:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191980.799197:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a3b02dc8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467631013440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (334us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191980.799204:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3622
00000100:00100000:3.0:1776191980.799245:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002986576f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467631013440:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191981.562233:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191981.818222:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1776191981.818238:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000542b51d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467631013504:0@lo:400:kworker/u8:4.0
00000100:00080000:1.0:1776191981.818258:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191981.818264:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191981.818268:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191981.818274:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4514
00000100:00080000:1.0:1776191981.818277:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1776191981.818283:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191981.818313:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000048d62137 x1862467631013952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191981.818322:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1776191981.818336:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191981.818340:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191981.818341:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191981.818345:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4514
00000100:00080000:1.0:1776191981.818347:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1776191981.818350:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191981.818438:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001c243e42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631013632:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191981.818469:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191981.818488:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb97b35c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467631013888:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191981.818509:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191981.818527:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:0.0:1776191981.818532:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000254994e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467631013568:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191981.818561:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191981.818576:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000250a4bd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631013824:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191981.818594:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191981.818624:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631013888
00000100:00100000:0.0:1776191981.818662:0:13323:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631013824
00000100:00100000:0.0:1776191981.818679:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2276
00000100:00100000:0.0:1776191981.818685:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d3569406 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467631013888:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191981.818732:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d3569406 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467631013888:12345-0@lo:400:kworker/u8:4.0 Request processed in 46us (222us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191981.818740:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2276
00000100:00100000:0.0:1776191981.818754:0:13323:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2277
00000100:00100000:0.0:1776191981.818758:0:13323:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de02bb16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467631013824:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191981.818782:0:13323:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de02bb16 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467631013824:12345-0@lo:400:kworker/u8:4.0 Request processed in 24us (188us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191981.818788:0:13323:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2277
00000100:00100000:0.0:1776191981.818805:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631013568
00000100:00100000:0.0:1776191981.818828:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5334
00000100:00100000:0.0:1776191981.818832:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004feb6fa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467631013568:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191981.818861:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004feb6fa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467631013568:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (300us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191981.818867:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5334
00000100:00100000:0.0:1776191981.818914:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000254994e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467631013568:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191981.818924:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000250a4bd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631013824:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191981.818931:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb97b35c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467631013888:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191981.818962:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048d62137 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631013952:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191981.818983:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191981.819004:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631013952
00000100:00100000:0.0:1776191981.819019:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2650
00000100:00100000:0.0:1776191981.819022:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004faaa807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467631013952:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191981.819144:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191981.819173:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004faaa807 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467631013952:12345-0@lo:8:kworker/u8:4.0 Request processed in 150us (190us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191981.819178:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2650
00000100:00080000:0.0:1776191981.819212:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191981.819215:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191981.819219:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048d62137 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631013952:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191981.819256:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631013504
00000100:00100000:0.0:1776191981.819279:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1976
00000100:00100000:0.0:1776191981.819283:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003026b1b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467631013504:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191981.819324:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003026b1b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3365:x1862467631013504:12345-0@lo:400:kworker/u8:4.0 Request processed in 40us (1007us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191981.819331:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1976
00000100:00100000:2.0:1776191981.819431:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000690142e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631013760:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191981.819462:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191981.819485:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bfc0fcff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631014080:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191981.819507:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191981.819525:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:2.0:1776191981.819530:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c4e82865 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467631013696:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191981.819547:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191981.819560:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ff9f217e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631014016:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191981.819576:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191981.819603:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631014080
00000100:00100000:2.0:1776191981.819625:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631014016
00000100:00100000:2.0:1776191981.819642:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1825
00000100:00100000:2.0:1776191981.819647:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f697c3d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467631014080:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1776191981.819666:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000542b51d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3365:1862467631013504:0@lo:400:kworker/u8:4.0
00002000:00000024:2.0:1776191981.819670:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191981.819697:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1826
00000100:00100000:3.0:1776191981.819703:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000037535091 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631014016:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191981.819709:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f697c3d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467631014080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (200us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191981.819716:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1825
00002000:00000024:3.0:1776191981.819717:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191981.819747:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631013696
00000100:00100000:3.0:1776191981.819752:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000037535091 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631014016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (174us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191981.819760:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1826
00000100:00100000:2.0:1776191981.819774:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5335
00000100:00100000:2.0:1776191981.819778:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d84175 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467631013696:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191981.819786:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631013632
00000100:00100000:2.0:1776191981.819814:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d84175 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467631013696:12345-0@lo:400:kworker/u8:4.0 Request processed in 33us (264us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191981.819815:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631013760
00000100:00100000:2.0:1776191981.819822:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5335
00000100:00100000:3.0:1776191981.819831:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3623
00000100:00100000:3.0:1776191981.819835:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008deca8e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467631013632:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191981.819867:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008deca8e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3364:x1862467631013632:12345-0@lo:400:kworker/u8:4.0 Request processed in 31us (1399us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191981.819873:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3623
00000100:00100000:3.0:1776191981.819885:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3624
00000100:00100000:3.0:1776191981.819890:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000231e853d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631013760:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191981.819920:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000231e853d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631013760:12345-0@lo:400:kworker/u8:4.0 Request processed in 30us (458us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191981.819925:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3624
00000100:00100000:2.0:1776191981.819937:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c4e82865 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467631013696:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191981.819955:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001c243e42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631013632:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191981.819976:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ff9f217e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631014016:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191981.819989:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000690142e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631013760:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191981.820064:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bfc0fcff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631014080:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191981.820365:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000841b9634 x1862467631014144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:0.0:1776191981.820417:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000841b9634 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631014144:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191981.820447:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191981.820538:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003f3f309a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467631014272:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191981.820564:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191981.820581:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1776191981.820585:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d10ef768 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467631014208:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191981.820603:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191981.820625:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631014272
00000100:00100000:1.0:1776191981.820650:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631014208
00000100:00100000:1.0:1776191981.820669:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5336
00000100:00100000:1.0:1776191981.820673:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000690142e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467631014272:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191981.820708:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000690142e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467631014272:12345-0@lo:400:kworker/u8:4.0 Request processed in 34us (143us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191981.820714:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5336
00000100:00100000:1.0:1776191981.820727:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5337
00000100:00100000:1.0:1776191981.820730:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4e82865 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467631014208:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191981.820755:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4e82865 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467631014208:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (151us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191981.820760:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5337
00000100:00100000:1.0:1776191981.820793:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d10ef768 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467631014208:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191981.820801:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003f3f309a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467631014272:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191981.820868:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631014144
00000100:00100000:2.0:1776191981.820894:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2651
00000100:00100000:2.0:1776191981.820898:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb4cf93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467631014144:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:2.0:1776191981.820990:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191981.821255:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb4cf93d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467631014144:12345-0@lo:8:kworker/u8:4.0 Request processed in 355us (808us total) trans 0 rc -19/-19
00000100:00080000:0.0:1776191981.821256:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191981.821260:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:2.0:1776191981.821261:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2651
00000100:00100000:0.0:1776191981.821263:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000841b9634 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631014144:0@lo:8:kworker/u8:4.0
00010000:00010000:3.0:1776191982.587656:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1776191983.452287:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191983.452396:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:1.0:1776191983.452478:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613834240
00000100:00100000:1.0:1776191983.452531:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1977
00000100:00100000:1.0:1776191983.452537:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be2451ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613834240:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191983.452617:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be2451ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2263:x1862467613834240:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 79us (339us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191983.452625:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1977
00000100:00100000:2.0:1776191983.453527:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613834304
00000100:00100000:2.0:1776191983.453576:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5338
00000100:00100000:2.0:1776191983.453581:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd341e03 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613834304:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191983.453634:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd341e03 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2263:x1862467613834304:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 52us (1239us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191983.453641:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5338
00000100:00100000:0.0:1776191983.455133:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191983.455172:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191983.455201:0:3356:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191983.455291:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613834496
00000100:00100000:2.0:1776191983.455327:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613834432
00000100:00100000:2.0:1776191983.455356:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2278
00000100:00100000:2.0:1776191983.455362:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000421d4a36 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613834432:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191983.455422:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000421d4a36 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2263:x1862467613834432:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 59us (221us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191983.455430:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2278
00000100:00100000:2.0:1776191983.455445:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2652
00000100:00100000:2.0:1776191983.455449:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006821defb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613834496:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:2.0:1776191983.455545:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191983.455572:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006821defb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613834496:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 122us (445us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191983.455578:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2652
00000100:00100000:1.0:1776191983.455693:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613834368
00000100:00100000:1.0:1776191983.455737:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5339
00000100:00100000:1.0:1776191983.455741:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008ef4d77e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613834368:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191983.455782:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008ef4d77e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2263:x1862467613834368:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 40us (611us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191983.455789:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5339
00010000:00010000:0.0:1776191983.610329:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191984.634594:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191984.890377:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1776191984.891536:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000067e0c0a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631014336:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191984.891609:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191984.891831:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631014336
00000100:00100000:0.0:1776191984.891925:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3625
00000100:00100000:0.0:1776191984.891931:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7e1534c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631014336:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1776191984.892086:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:0.0:1776191984.892304:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7e1534c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631014336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 372us (694us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191984.892312:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3625
00000100:00100000:2.0:1776191984.892420:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000067e0c0a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631014336:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191985.658257:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191985.916678:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002986576f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631014400:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1776191985.916749:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191985.917178:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631014400
00000100:00100000:3.0:1776191985.917236:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3626
00000100:00100000:3.0:1776191985.917242:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000278fd18d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467631014400:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191985.917275:0:8673:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191985.917326:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000278fd18d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467631014400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (577us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191985.917332:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3626
00000100:00100000:2.0:1776191985.917626:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002986576f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631014400:0@lo:41:osp-pre-0-1.0
00010000:00010000:0.0:1776191986.693101:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191986.939438:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f598cfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631014528:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191986.939503:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191986.939711:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ddf82b42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631014464:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1776191986.939742:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1776191986.939861:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191986.939866:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191986.939869:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191986.939874:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4519
00000100:00080000:2.0:1776191986.939876:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1776191986.939881:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191986.939972:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000038b90f22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631014720:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191986.939997:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191986.940014:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776191986.940020:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000017fc0dbf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467631014784:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191986.940138:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191986.940180:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631014784
00000100:00100000:0.0:1776191986.940227:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5340
00000100:00100000:0.0:1776191986.940232:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ff9f217e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467631014784:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191986.940712:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ff9f217e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3363:x1862467631014784:12345-0@lo:400:kworker/u8:4.0 Request processed in 477us (573us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191986.940719:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5340
00000100:00100000:0.0:1776191986.940741:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000033b3f754 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467631014656:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191986.940767:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191986.940782:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000040035503 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631014912:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191986.940814:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191986.940832:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:0.0:1776191986.940837:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000446d5aa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467631014592:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191986.940862:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191986.940878:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000871997a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631014848:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191986.940898:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191986.940938:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631014592
00000100:00100000:0.0:1776191986.940965:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1978
00000100:00100000:0.0:1776191986.940969:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f9c8ab18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467631014592:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191986.941004:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f9c8ab18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3366:x1862467631014592:12345-0@lo:400:kworker/u8:4.0 Request processed in 34us (142us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191986.941009:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1978
00000100:00100000:0.0:1776191986.941070:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631014720
00000100:00100000:0.0:1776191986.941093:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631014848
00000100:00100000:0.0:1776191986.941104:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3627
00000100:00100000:0.0:1776191986.941108:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bfc0fcff pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467631014720:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191986.941137:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bfc0fcff pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3363:x1862467631014720:12345-0@lo:400:kworker/u8:4.0 Request processed in 28us (1140us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191986.941143:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3627
00000100:00100000:0.0:1776191986.941154:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3628
00000100:00100000:0.0:1776191986.941158:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000290b34e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631014848:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191986.941182:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000290b34e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631014848:12345-0@lo:400:kworker/u8:4.0 Request processed in 24us (284us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191986.941196:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3628
00000100:00100000:0.0:1776191986.941221:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631014656
00000100:00100000:0.0:1776191986.941255:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5341
00000100:00100000:0.0:1776191986.941267:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000138721a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467631014656:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191986.941293:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000138721a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467631014656:12345-0@lo:400:kworker/u8:4.0 Request processed in 33us (526us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191986.941299:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5341
00000100:00100000:0.0:1776191986.941331:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000446d5aa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3366:1862467631014592:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191986.941343:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000871997a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631014848:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191986.941351:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000033b3f754 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467631014656:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191986.941382:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000017fc0dbf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3363:1862467631014784:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191986.941417:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000038b90f22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631014720:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191986.941504:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631014912
00000100:00100000:0.0:1776191986.941528:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2279
00000100:00100000:0.0:1776191986.941531:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e8375317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631014912:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191986.941565:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e8375317 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631014912:12345-0@lo:400:kworker/u8:4.0 Request processed in 32us (751us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191986.941574:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2279
00000100:00100000:0.0:1776191986.941604:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000040035503 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631014912:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191986.941670:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000061b94ee x1862467631014976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:2.0:1776191986.941700:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1776191986.941704:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1776191986.941707:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1776191986.941711:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4519
00000100:00080000:2.0:1776191986.941713:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1776191986.941717:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:2.0:1776191986.941740:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000008826861 x1862467631015040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:3.0:1776191986.941747:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631014528
00000100:00100000:3.0:1776191986.941787:0:14418:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631014464
00000100:00100000:2.0:1776191986.941795:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1b66093 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467631015168:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191986.941808:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1827
00000100:00100000:3.0:1776191986.941814:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003f3f309a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467631014528:12345-0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191986.941830:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00002000:00000024:3.0:1776191986.941840:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191986.941854:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1776191986.941862:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000500f9601 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467631015104:0@lo:400:kworker/u8:4.0
00000100:00100000:3.0:1776191986.941881:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003f3f309a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467631014528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (2378us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191986.941892:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1827
00000100:00100000:2.0:1776191986.941893:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191986.941910:0:14418:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1828
00000100:00100000:3.0:1776191986.941916:0:14418:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000067e0c0a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631014464:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1776191986.941929:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f598cfd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631014528:0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191986.941930:0:14418:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:2.0:1776191986.941957:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631015168
00000100:00100000:3.0:1776191986.941962:0:14418:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000067e0c0a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631014464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (2218us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191986.941968:0:14418:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1828
00000100:00100000:2.0:1776191986.941985:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631015104
00000100:00100000:3.0:1776191986.942011:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5342
00000100:00100000:3.0:1776191986.942016:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000040035503 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467631015168:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191986.942598:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000061b94ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631014976:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191986.943621:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191986.943649:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000008826861 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631015040:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191986.943669:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191986.943708:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631014976
00000100:00100000:0.0:1776191986.943733:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631015040
00000100:00100000:0.0:1776191986.943746:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2653
00000100:00100000:0.0:1776191986.943751:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001dcb8edb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467631014976:12345-0@lo:8:kworker/u8:4.0
00000100:00100000:2.0:1776191986.944043:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5343
00000100:00100000:2.0:1776191986.944049:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000038b90f22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467631015104:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191986.944172:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2654
00000100:00100000:1.0:1776191986.944176:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001f598cfd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467631015040:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191986.944658:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191986.944709:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001dcb8edb pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467631014976:12345-0@lo:8:kworker/u8:4.0 Request processed in 957us (1090us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191986.944715:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2653
00000100:00080000:0.0:1776191986.944752:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191986.944755:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191986.944759:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000061b94ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631014976:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191986.944826:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ddf82b42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631014464:0@lo:13:osp-pre-0-0.0
00010000:02020000:1.0:1776191986.945002:0:9714:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1776191986.945050:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001f598cfd pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3362:x1862467631015040:12345-0@lo:8:kworker/u8:4.0 Request processed in 872us (1379us total) trans 0 rc -19/-19
00000100:00100000:1.0:1776191986.945056:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2654
00000100:00100000:2.0:1776191986.947054:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000038b90f22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467631015104:12345-0@lo:400:kworker/u8:4.0 Request processed in 2983us (5144us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191986.947069:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5343
00000100:00100000:2.0:1776191986.947133:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000500f9601 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467631015104:0@lo:400:kworker/u8:4.0
00000100:00080000:0.0:1776191986.947287:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191986.947291:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191986.947295:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000008826861 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631015040:0@lo:8:kworker/u8:4.0
00000100:00100000:3.0:1776191986.948602:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000040035503 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467631015168:12345-0@lo:400:kworker/u8:4.0 Request processed in 6580us (6768us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191986.948615:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5342
00000100:00100000:2.0:1776191986.948850:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1b66093 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467631015168:0@lo:400:kworker/u8:4.0
00010000:00010000:3.0:1776191987.709686:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191988.570407:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191988.570508:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191988.570548:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191988.570577:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:2.0:1776191988.570711:0:9714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613834752
00000100:00100000:2.0:1776191988.570770:0:9714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2280
00000100:00100000:2.0:1776191988.570788:0:9714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002986576f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613834752:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191988.570856:0:9714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002986576f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2264:x1862467613834752:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 79us (349us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191988.570863:0:9714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2280
00000100:00100000:2.0:1776191988.570900:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613834560
00000100:00100000:2.0:1776191988.570920:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1979
00000100:00100000:2.0:1776191988.570924:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081b9520e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613834560:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:2.0:1776191988.570946:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081b9520e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2264:x1862467613834560:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 21us (398us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191988.570951:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1979
00000100:00100000:3.0:1776191988.577804:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:0.0:1776191988.577897:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613834816
00000100:00100000:0.0:1776191988.577942:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2655
00000100:00100000:0.0:1776191988.577948:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b69f705b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613834816:12345-192.168.203.36@tcp:8:kworker/u8:1.0
00010000:02020000:0.0:1776191988.578062:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191988.578117:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b69f705b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2262:x1862467613834816:12345-192.168.203.36@tcp:8:kworker/u8:1.0 Request processed in 169us (323us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191988.578125:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2655
00000100:00100000:1.0:1776191988.580374:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613834624
00000100:00100000:1.0:1776191988.580458:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613834688
00000100:00100000:1.0:1776191988.580484:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5344
00000100:00100000:1.0:1776191988.580489:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e63aab7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613834624:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191988.580561:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e63aab7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2264:x1862467613834624:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 71us (10162us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191988.580569:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5344
00000100:00100000:1.0:1776191988.580591:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5345
00000100:00100000:1.0:1776191988.580595:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eea60842 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613834688:12345-192.168.203.36@tcp:400:kworker/u8:1.0
00000100:00100000:1.0:1776191988.580616:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eea60842 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2264:x1862467613834688:12345-192.168.203.36@tcp:400:kworker/u8:1.0 Request processed in 21us (10040us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191988.580621:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5345
00010000:00010000:3.0:1776191988.730524:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1776191989.754779:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191990.010922:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776191990.010945:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002f06a876 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631015232:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1776191990.011022:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191990.011286:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631015232
00000100:00100000:2.0:1776191990.011336:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3629
00000100:00100000:2.0:1776191990.011342:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d10ef768 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631015232:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1776191990.011378:0:6271:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:2.0:1776191990.011431:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d10ef768 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631015232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (408us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191990.011437:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3629
00000100:00100000:1.0:1776191990.011513:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002f06a876 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631015232:0@lo:41:osp-pre-1-0.0
00010000:00010000:3.0:1776191990.780400:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191991.036798:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005c5a025e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631015296:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1776191991.036867:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191991.037062:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631015296
00000100:00100000:3.0:1776191991.037114:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3630
00000100:00100000:3.0:1776191991.037120:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c243e42 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467631015296:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1776191991.037150:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:3.0:1776191991.037198:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c243e42 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467631015296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (332us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191991.037205:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3630
00000100:00100000:1.0:1776191991.037445:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005c5a025e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631015296:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191991.802453:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1776191992.059236:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023cc91bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631015360:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191992.059301:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191992.059395:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631015360
00000100:00100000:0.0:1776191992.059448:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1829
00000100:00100000:0.0:1776191992.059454:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000542b51d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631015360:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1776191992.059484:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:0.0:1776191992.059528:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000542b51d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3363:x1862467631015360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (228us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191992.059535:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1829
00000100:00100000:0.0:1776191992.059580:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023cc91bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3363:1862467631015360:0@lo:13:osp-pre-0-0.0
00000100:00080000:1.0:1776191992.059831:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191992.059836:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191992.059839:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191992.059843:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4525
00000100:00080000:1.0:1776191992.059846:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1776191992.059850:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191992.059869:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@000000005b1b67b1 x1862467631015808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:1.0:1776191992.059883:0:1376:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1776191992.059886:0:1376:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1776191992.059887:0:1376:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1776191992.059890:0:1376:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4525
00000100:00080000:1.0:1776191992.059892:0:1376:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1776191992.059894:0:1376:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:1.0:1776191992.059923:0:1376:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@0000000073716db5 x1862467631015872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191992.059954:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000250a4bd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631015552:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191992.059984:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191992.059999:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005c6da23c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467631015936:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191992.060023:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191992.060056:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:1.0:1776191992.060062:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb97b35c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467631015488:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191992.060095:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191992.060109:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae81ed6a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631015744:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191992.060128:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191992.060154:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631015936
00000100:00100000:1.0:1776191992.060180:0:6266:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631015488
00000100:00100000:1.0:1776191992.060195:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5346
00000100:00100000:1.0:1776191992.060199:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ac42fbca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467631015936:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191992.060233:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ac42fbca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3366:x1862467631015936:12345-0@lo:400:kworker/u8:4.0 Request processed in 33us (210us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191992.060238:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5346
00000100:00100000:1.0:1776191992.060250:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5347
00000100:00100000:1.0:1776191992.060253:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001425031c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467631015488:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191992.060276:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001425031c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3366:x1862467631015488:12345-0@lo:400:kworker/u8:4.0 Request processed in 23us (182us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191992.060281:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5347
00000100:00100000:1.0:1776191992.060309:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb97b35c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3366:1862467631015488:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191992.060318:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005c6da23c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3366:1862467631015936:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191992.060447:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631015552
00000100:00100000:2.0:1776191992.060481:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3631
00000100:00100000:2.0:1776191992.060484:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000698fe8e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467631015552:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191992.060521:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000698fe8e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467631015552:12345-0@lo:400:kworker/u8:4.0 Request processed in 35us (536us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191992.060525:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3631
00000100:00100000:2.0:1776191992.060544:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048d62137 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467631015424:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191992.060571:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191992.060583:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000841b9634 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467631015680:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191992.060601:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191992.060614:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:2.0:1776191992.060619:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000254994e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467631015616:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191992.060636:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191992.060649:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000424d0623 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467631016000:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191992.060667:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191992.060688:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631015616
00000100:00100000:2.0:1776191992.060709:0:14414:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631016000
00000100:00100000:2.0:1776191992.060724:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5348
00000100:00100000:2.0:1776191992.060728:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000500f9601 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467631015616:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191992.060757:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000500f9601 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3364:x1862467631015616:12345-0@lo:400:kworker/u8:4.0 Request processed in 29us (120us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191992.060762:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5348
00000100:00100000:2.0:1776191992.060773:0:14414:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5349
00000100:00100000:2.0:1776191992.060776:0:14414:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000017fc0dbf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467631016000:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191992.060799:0:14414:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000017fc0dbf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3364:x1862467631016000:12345-0@lo:400:kworker/u8:4.0 Request processed in 22us (132us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191992.060804:0:14414:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5349
00000100:00100000:2.0:1776191992.060828:0:6271:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631015680
00000100:00100000:2.0:1776191992.060844:0:6271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3632
00000100:00100000:2.0:1776191992.060848:0:6271:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1b66093 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467631015680:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191992.060875:0:6271:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1b66093 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467631015680:12345-0@lo:400:kworker/u8:4.0 Request processed in 26us (273us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191992.060883:0:6271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3632
00000100:00100000:2.0:1776191992.060968:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000254994e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3364:1862467631015616:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191992.060979:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000424d0623 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3364:1862467631016000:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191992.060986:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000841b9634 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467631015680:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191992.061010:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000250a4bd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631015552:0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191992.061168:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b1b67b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631015808:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191992.061198:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191992.061216:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000073716db5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631015872:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191992.061234:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191992.061260:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631015424
00000100:00100000:0.0:1776191992.061283:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1980
00000100:00100000:0.0:1776191992.061287:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b0b64a4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467631015424:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191992.061316:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b0b64a4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467631015424:12345-0@lo:400:kworker/u8:4.0 Request processed in 29us (745us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191992.061321:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1980
00000100:00100000:0.0:1776191992.061389:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631015744
00000100:00100000:0.0:1776191992.061411:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631015808
00000100:00100000:0.0:1776191992.061425:0:8237:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631015872
00000100:00100000:0.0:1776191992.061436:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2281
00000100:00100000:0.0:1776191992.061440:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c5625d66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467631015744:12345-0@lo:400:kworker/u8:4.0
00000100:00100000:0.0:1776191992.061475:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c5625d66 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3366:x1862467631015744:12345-0@lo:400:kworker/u8:4.0 Request processed in 34us (1346us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191992.061480:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2281
00000100:00100000:0.0:1776191992.061491:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2656
00000100:00100000:0.0:1776191992.061495:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c82f0bae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467631015808:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191992.061589:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191992.061620:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c82f0bae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467631015808:12345-0@lo:8:kworker/u8:4.0 Request processed in 124us (422us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191992.061625:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2656
00000100:00100000:0.0:1776191992.061635:0:8237:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2657
00000100:00100000:0.0:1776191992.061638:0:8237:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000000a829dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467631015872:12345-0@lo:8:kworker/u8:4.0
00010000:02020000:0.0:1776191992.061717:0:8237:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1776191992.061739:0:8237:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000000a829dc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3362:x1862467631015872:12345-0@lo:8:kworker/u8:4.0 Request processed in 100us (505us total) trans 0 rc -19/-19
00000100:00100000:0.0:1776191992.061744:0:8237:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2657
00000100:00080000:0.0:1776191992.061776:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191992.061780:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191992.061783:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b1b67b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631015808:0@lo:8:kworker/u8:4.0
00000100:00080000:0.0:1776191992.061788:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1776191992.061791:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:0.0:1776191992.061794:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000073716db5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631015872:0@lo:8:kworker/u8:4.0
00000100:00100000:0.0:1776191992.061813:0:3363:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1776191992.061820:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000023cc91bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631016064:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1776191992.061846:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1776191992.061873:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae81ed6a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631015744:0@lo:400:kworker/u8:4.0
00000100:00100000:2.0:1776191992.062156:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048d62137 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467631015424:0@lo:400:kworker/u8:4.0
00000100:00100000:1.0:1776191992.062324:0:8240:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631016064
00000100:00100000:1.0:1776191992.062361:0:8240:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1830
00000100:00100000:1.0:1776191992.062364:0:8240:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008b7326a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467631016064:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1776191992.062381:0:8240:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:1.0:1776191992.062424:0:8240:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008b7326a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467631016064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (577us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191992.062432:0:8240:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1830
00000100:00100000:2.0:1776191992.062718:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000023cc91bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631016064:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1776191992.826740:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191993.692974:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191993.693021:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191993.693088:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191993.693118:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191993.693137:0:3358:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.36@tcp (source: 12345-192.168.203.36@tcp)
00000100:00100000:3.0:1776191993.693164:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613835008
00000100:00100000:3.0:1776191993.693201:0:13715:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613834944
00000100:00100000:2.0:1776191993.693385:0:6260:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613834880
00000100:00100000:2.0:1776191993.693410:0:6260:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 1981
00000100:00100000:2.0:1776191993.693416:0:6260:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085b2d193 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613834880:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191993.693484:0:6260:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085b2d193 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d683993-55d1-4c2a-b613-4da1b6169cf9+9:2265:x1862467613834880:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 67us (463us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191993.693491:0:6260:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 1981
00000100:00100000:2.0:1776191993.693531:0:6266:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5350
00000100:00100000:2.0:1776191993.693536:0:6266:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d7dbbaf2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613835008:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191993.693559:0:6266:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d7dbbaf2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fefb7bd-5ea0-4db1-a023-0797c05a037e+5:2265:x1862467613835008:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 23us (471us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191993.693564:0:6266:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5350
00000100:00100000:2.0:1776191993.693589:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613835136
00000100:00100000:2.0:1776191993.693604:0:13321:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467613835072
00000100:00100000:2.0:1776191993.693619:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2282
00000100:00100000:2.0:1776191993.693623:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000062801b3d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613835072:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:2.0:1776191993.693642:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000062801b3d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:3fefb7bd-5ea0-4db1-a023-0797c05a037e+6:2265:x1862467613835072:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 19us (505us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191993.693648:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2282
00000100:00100000:2.0:1776191993.693657:0:13321:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 2658
00000100:00100000:2.0:1776191993.693660:0:13321:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000069c1692e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613835136:12345-192.168.203.36@tcp:8:kworker/u8:4.0
00010000:02020000:2.0:1776191993.693755:0:13321:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 192.168.203.36@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191993.693774:0:13321:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000069c1692e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2262:x1862467613835136:12345-192.168.203.36@tcp:8:kworker/u8:4.0 Request processed in 113us (807us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191993.693779:0:13321:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 2658
00000100:00100000:3.0:1776191993.693918:0:13715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.36@tcp, seq: 5351
00000100:00100000:3.0:1776191993.693922:0:13715:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003ac71d2b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613834944:12345-192.168.203.36@tcp:400:kworker/u8:4.0
00000100:00100000:3.0:1776191993.693945:0:13715:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003ac71d2b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3fefb7bd-5ea0-4db1-a023-0797c05a037e+12:2265:x1862467613834944:12345-192.168.203.36@tcp:400:kworker/u8:4.0 Request processed in 23us (828us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191993.693951:0:13715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.36@tcp, seq: 5351
00010000:00010000:3.0:1776191993.853523:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1776191994.875245:0:6253:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1776191995.130824:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1776191995.130899:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000060360b30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631016128:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1776191995.130970:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191995.131339:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631016128
00000100:00100000:1.0:1776191995.135204:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3633
00000100:00100000:1.0:1776191995.135217:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000033b3f754 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631016128:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1776191995.135261:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446219776 avail 1316757504
00000100:00100000:1.0:1776191995.135398:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000033b3f754 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631016128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 182us (4429us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191995.135406:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3633
00000100:00100000:2.0:1776191995.139190:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000060360b30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631016128:0@lo:41:osp-pre-1-0.0
00010000:00010000:0.0:1776191995.898868:0:8262:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1776191996.154388:0:3365:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1776191996.154414:0:3365:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005c6da23c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467631016192:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1776191996.154482:0:3365:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191996.156342:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631016192
00000100:00100000:2.0:1776191996.156419:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3634
00000100:00100000:2.0:1776191996.156561:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000924b81a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467631016192:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1776191996.156599:0:6270:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446006784 avail 1316544512
00000100:00100000:2.0:1776191996.156838:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000924b81a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3365:x1862467631016192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 412us (2357us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191996.156846:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3634
00000100:00100000:3.0:1776191996.156913:0:3365:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005c6da23c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3365:1862467631016192:0@lo:41:osp-pre-0-1.0
00010000:00010000:3.0:1776191996.922989:0:6254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1776191997.178461:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191997.178469:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191997.178472:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191997.178481:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4530
00000100:00080000:0.0:1776191997.178484:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1776191997.178490:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0001: import 00000000e5cbce32 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191997.178510:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000b9f58501 x1862467631016704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00080000:0.0:1776191997.178526:0:18709:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1776191997.178529:0:18709:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1776191997.178531:0:18709:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1776191997.178533:0:18709:0:(import.c:534:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4530
00000100:00080000:0.0:1776191997.178535:0:18709:0:(import.c:581:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1776191997.178538:0:18709:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-MDT0000: import 00000000c636a602 using connection 192.168.203.136@tcp/0@lo
00000100:00100000:0.0:1776191997.178548:0:18709:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@00000000551a670c x1862467631016768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00100000:1.0:1776191997.178697:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f001d003 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467631016320:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191997.178891:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191997.178922:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000036dae86d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631016576:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191997.178946:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191997.178975:0:3364:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:1.0:1776191997.178980:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006c1f8cff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467631016256:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191997.179006:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191997.179022:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000cd64c98 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467631016512:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191997.179202:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191997.179239:0:6259:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631016256
00000100:00100000:1.0:1776191997.179281:0:6259:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1982
00000100:00100000:1.0:1776191997.179287:0:6259:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cef7ed6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467631016256:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191997.179338:0:6259:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cef7ed6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfe5e3be-06a0-431e-b004-d8eaae446cdf+20:3364:x1862467631016256:12345-0@lo:400:kworker/u8:2.0 Request processed in 50us (331us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191997.179345:0:6259:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1982
00000100:00100000:1.0:1776191997.179381:0:6270:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631016512
00000100:00100000:1.0:1776191997.179404:0:6270:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3635
00000100:00100000:1.0:1776191997.179407:0:6270:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000086c77a9e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467631016512:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191997.179436:0:6270:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000086c77a9e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3364:x1862467631016512:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (234us total) trans 0 rc 0/0
00000100:00100000:1.0:1776191997.179441:0:6270:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3635
00000100:00100000:1.0:1776191997.179463:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008291e08d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467631016448:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191997.179485:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191997.179502:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000871997a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631016832:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191997.179529:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191997.179548:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:2.0:1776191997.179580:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b9f58501 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631016704:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191997.179613:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191997.179640:0:3363:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000446d5aa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631016896:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1776191997.179671:0:3363:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1776191997.179705:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631016320
00000100:00100000:2.0:1776191997.179710:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631016576
00000100:00100000:2.0:1776191997.179741:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631016704
00000100:00100000:2.0:1776191997.179756:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2283
00000100:00100000:2.0:1776191997.179760:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ed5180d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467631016576:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191997.179789:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ed5180d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3364:x1862467631016576:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (844us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191997.179796:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2283
00000100:00100000:3.0:1776191997.179809:0:13714:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631016448
00000100:00100000:2.0:1776191997.179813:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2659
00000100:00100000:2.0:1776191997.179818:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000a4e1064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467631016704:12345-0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191997.179836:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5352
00000100:00100000:3.0:1776191997.179841:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2a7dce2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467631016320:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191997.179876:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2a7dce2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3364:x1862467631016320:12345-0@lo:400:kworker/u8:2.0 Request processed in 34us (1031us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191997.179882:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5352
00000100:00100000:3.0:1776191997.179893:0:13714:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5353
00000100:00100000:3.0:1776191997.179897:0:13714:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c345c5b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467631016448:12345-0@lo:400:kworker/u8:2.0
00010000:02020000:2.0:1776191997.179913:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1776191997.179923:0:13714:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c345c5b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3366:x1862467631016448:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (437us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191997.179929:0:13714:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5353
00000100:00100000:2.0:1776191997.179953:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000a4e1064 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467631016704:12345-0@lo:8:kworker/u8:2.0 Request processed in 133us (339us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191997.179961:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2659
00000100:00080000:3.0:1776191997.180022:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000e5cbce32 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1776191997.180026:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:3.0:1776191997.180032:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b9f58501 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3362:1862467631016704:0@lo:8:kworker/u8:2.0
00000100:00100000:3.0:1776191997.180096:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631016832
00000100:00100000:2.0:1776191997.180160:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006c1f8cff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfe5e3be-06a0-431e-b004-d8eaae446cdf:3364:1862467631016256:0@lo:400:kworker/u8:2.0
00000100:00100000:3.0:1776191997.180185:0:18399:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631016896
00000100:00100000:3.0:1776191997.180205:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1831
00000100:00100000:3.0:1776191997.180209:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a34feed9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631016832:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1776191997.180230:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191997.180260:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a34feed9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631016832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (730us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191997.180265:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1831
00000100:00100000:3.0:1776191997.180276:0:18399:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1832
00000100:00100000:3.0:1776191997.180279:0:18399:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000008826861 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467631016896:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1776191997.180288:0:18399:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 24518336 pending 0 free 3914231808 avail 3682709504
00000100:00100000:3.0:1776191997.180311:0:18399:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000008826861 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3363:x1862467631016896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 31us (640us total) trans 0 rc 0/0
00000100:00100000:3.0:1776191997.180316:0:18399:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1832
00000100:00100000:3.0:1776191997.180355:0:3363:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000446d5aa9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3363:1862467631016896:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1776191997.180677:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006baa4949 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631016384:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191997.180708:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191997.180729:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cb1d57ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631016640:0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191997.180837:0:8673:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631016384
00000100:00100000:0.0:1776191997.180862:0:8673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3636
00000100:00100000:0.0:1776191997.180866:0:8673:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a70c215b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467631016384:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:0.0:1776191997.180900:0:8673:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a70c215b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3366:x1862467631016384:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (192us total) trans 0 rc 0/0
00000100:00100000:0.0:1776191997.180906:0:8673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3636
00000100:00100000:2.0:1776191997.181103:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000cd64c98 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3364:1862467631016512:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191997.181120:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f001d003 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3364:1862467631016320:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191997.181129:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000036dae86d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3364:1862467631016576:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191997.181151:0:3364:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000011eb3cbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467631016960:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191997.181325:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191997.181357:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008291e08d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3366:1862467631016448:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191997.181374:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000871997a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631016832:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1776191997.181384:0:3366:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1776191997.181392:0:3366:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003f01d2f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467631017024:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191997.181414:0:3366:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191997.181434:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006baa4949 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3366:1862467631016384:0@lo:400:kworker/u8:2.0
00000100:00100000:1.0:1776191997.181483:0:3362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000551a670c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631016768:0@lo:8:kworker/u8:2.0
00000100:00100000:2.0:1776191997.181490:0:3364:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1776191997.181516:0:3362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1776191997.181528:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631017024
00000100:00100000:2.0:1776191997.181557:0:6267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631016960
00000100:00100000:2.0:1776191997.181574:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5354
00000100:00100000:2.0:1776191997.181578:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad4a7212 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467631017024:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191997.181614:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad4a7212 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3366:x1862467631017024:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (200us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191997.181621:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5354
00000100:00100000:2.0:1776191997.181634:0:6267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5355
00000100:00100000:2.0:1776191997.181637:0:6267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006df8bd7e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467631016960:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191997.181667:0:6267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006df8bd7e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3364:x1862467631016960:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (180us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191997.181672:0:6267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5355
00000100:00100000:2.0:1776191997.181693:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631016640
00000100:00100000:2.0:1776191997.181710:0:8235:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467631016768
00000100:00100000:2.0:1776191997.181723:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2284
00000100:00100000:2.0:1776191997.181726:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b5b887d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631016640:12345-0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191997.181754:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b5b887d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3366:x1862467631016640:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (429us total) trans 0 rc 0/0
00000100:00100000:2.0:1776191997.181760:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2284
00000100:00100000:2.0:1776191997.181770:0:8235:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2660
00000100:00100000:2.0:1776191997.181773:0:8235:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008cc5f0ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467631016768:12345-0@lo:8:kworker/u8:2.0
00010000:02020000:2.0:1776191997.182674:0:8235:0:(ldlm_lib.c:1124:target_handle_connect()) 137-5: lustre-OST0001_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1776191997.182725:0:8235:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008cc5f0ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3362:x1862467631016768:12345-0@lo:8:kworker/u8:2.0 Request processed in 948us (1209us total) trans 0 rc -19/-19
00000100:00100000:2.0:1776191997.182735:0:8235:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2660
00000100:00100000:2.0:1776191997.182785:0:3364:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000011eb3cbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3364:1862467631016960:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191997.182830:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003f01d2f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3366:1862467631017024:0@lo:400:kworker/u8:2.0
00000100:00100000:2.0:1776191997.182840:0:3366:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cb1d57ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3366:1862467631016640:0@lo:400:kworker/u8:2.0
00000100:00080000:1.0:1776191997.185340:0:3362:0:(import.c:86:import_set_state_nolock()) 00000000c636a602 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1776191997.185349:0:3362:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.136@tcp failed (-19)
00000100:00100000:1.0:1776191997.185357:0:3362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000551a670c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3362:1862467631016768:0@lo:8:kworker/u8:2.0
Debug log: 35553 lines, 35553 kept, 0 dropped, 0 bad.